In this project, I have established a ETL data pipeline using dataproc (spark) on Google Cloud Platform to extract data from Google cloud Storage (data lake), do some data transform and cleaning using ...

Recently, Google announced the general availability of Bigtable federated queries, with BigQuery allowing customers to query data residing in Bigtable via BigQuery faster. Moreover, the querying ...

A robust ETL (Extract, Transform, Load) pipeline that processes telecom customer data using Apache Airflow for orchestration and Google BigQuery for data warehousing. The pipeline includes customer ...