Google is getting into the data lake business

Google Cloud is expanding into the data lake storage space with a new product called BigLake, based on its BigQuery service.

Although the name might not be the most creative, the service is a very interesting extension for Google as it pursues Amazon Web Services and Microsoft Azure into the cloud market.

BigLake, available now in preview (opens in a new tab), helps companies unify their data warehouses and data lakes without having to worry about compatibility across all sources. The service works with Amazon S3, Azure Data Lake Storage Gen2 and Google Cloud Storage.

“The biggest advantage then is that you don’t have to duplicate your data in two different environments and create data silos,” said Google’s Sudhir Hasbe. Protocol (opens in a new tab).

Google Cloud BigLake

(Image credit: Google Cloud)

Data Lake House

Google describes BigLake as a “data lakehouse,” an extension of a data lake that integrates other services, including data management and optimization, machine learning, and governance tools.

Google’s ultimate goal is to offer these services at a lower cost than its competitors, which bundling them together can help achieve.

“We have tens of thousands of customers on [BigQuery]and we’ve invested heavily in governance, security, and all the core functionality, so we’re taking that innovation from BigQuery and now extending it to all data that’s in different formats as well as lake environments – whether that either on Google Cloud with Google Cloud Storage, whether on AWS or Azure,” Hasbe said.

According to Google, BigQuery processes on average more than 110 terabytes of data per second.

The supremacy of the cloud

The race to become the ultimate cloud service provider has intensified in recent years.

The leader is AWS, the Amazon giant that has created entirely new categories of services and dominates the market.

But Microsoft and Google are hot on its heels, especially when it comes to some specific apps. Azure, for example, has been able to leverage Microsoft’s historical connections with businesses to great effect.

Exactly how this all pans out remains to be seen, but Google is stepping up its utilities shows the fierce nature of the battle.