← This weekAnalysisData engineering & the warehouse/lakehouseAmazonGoogleAmazon S3 Tables and Google BigQuery can now be connected using IAM-based access control, allowing users to query data stored in Amazon S3 from BigQuery without transferring it across clouds. This integration leverages the AWS Glue Iceberg REST Catalog to maintain a single governed dataset.
MyDataWork POV — For data teams juggling multi-cloud environments, this IAM-based access control between Amazon S3 and Google BigQuery is a practical boon. It eliminates the cumbersome data transfer step, preserving both time and governance integrity. However, if your operations are squarely within a single cloud, this may be an unnecessary complexity. The real win here is for those who need seamless cross-cloud queries without the usual data duplication headaches.
Discussion happens on Reddit — no comments are hosted here.