Google Builds Data Lake On BigQuery
Written by Kay Ewbank   
Thursday, 07 April 2022

Google has launched BigLake, a data platform built on Google BigQuery and Dataplex that can be used for data analysis for both structured and unstructured data

The BigLake team says it gives users fine-grained access controls, along with performance acceleration across BigQuery and multicloud data lakes on AWS and Azure. BigLake also makes that data uniformly accessible across Google Cloud and open source engines with consistent security.

bigquery

Google BigQuery is a distributed, serverless SQL engine that provides a way to query petabytes of data. It has built in machine learning, is serverless, and supported by Google Cloud. Dataplex is described as "an intelligent data fabric that unifies your distributed data to help automate data management and power analytics at scale." It was introduced by Google in 2021, and in BigLake is used to automatically scan Google Cloud storage to register BigLake table definitions in BigQuery, and makes them available via Dataproc Metastore.

BigLake works by using access delegation to deal with the problem of accessing the data without needing direct access to the underlying cloud storage data. Access delegation can be used to securely grant row and column level access to users and pipelines without having to provide full access to the table by using BigQuery to enforce the row and column level access controls.

BigLake means BigQuery can now be used with multicloud data lakes and open formats such as Parquet and ORC with fine-grained security controls. The integration with Dataplex means you can keep a single copy of data and enforce consistent access controls across analytics engines including Google Cloud and open-source technologies such as Spark, Presto, Trino, and Tensorflow.

Google BigLake is available now.

 bigquery

 

 

 

More Information

Google BigLake Website

Google BigQuery

Related Articles

 Google BigQuery Updated

BigQuery Updated and Repriced

Google BigQuery Updated

BigQuery Now Open to All

Google BigQuery Service

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


Gemini On-Device - Generative AI For Robots
09/07/2025

In that same way Gemini can produce text, write poetry,  summarize an article, write code, and generate images, it can also generate robot actions with Gemini Robotics. Now, the new Gemini Roboti [ ... ]



The Impact Of Code Club
25/06/2025

In the era of AI, the Raspberry Pi Foundation takes the view that learning how to create with technology has never been more important. Last year it revamped its Code Club network of free co [ ... ]


More News

pico book

 

Comments




or email your comment to: comments@i-programmer.info