🌥️ A lightweight data pipeline based on Google Cloud's Storage, Functions, Tasks and Scheduler.

A python script for upload Online File to Google Cloud Storage (GCS) built on Docker

This repository is for sharing knowledge, thoughts and approaches to multi-cloud and best-practice ways of working.

Terraform Modules for GCP

Stream CSV data from Google Cloud Storage to BigQuery using Apache Beam Dataflow, featuring dynamic schema detection and flexible runner options.

Terragrunt Infrastructure for a project called Crypto4All

End to End Data Engineering flow using GCP, Prefect, DBT, BigQuery, and Looker tools

An example how to use custom metrics in GKE

Data engineering project for TLC taxi Parquet data following an ELT model (extraction, load, transform)

Analysis of NYC's citibike data. Technologies: Python , Prefect, dbt, Terraform , Looker data studio

Kogito Serverless Workflow Google GCP example

A reference implementation of Vertex Pipelines for creating a production-ready MLOps solution on Google Cloud.

Golang code to handle aws and gcp services

Apache Beam pipeline to analyze London bicycle hiring dataset with GCP Dataflow

The ETL pipeline for Stock info.

Analyzing and optimizing the cost of a cloud-based application or infrastructure

Entire ETL pipeline project from data ingestion, transformation and finally analytics with Google Looker Studio

Customize google cloud platform dashboard and change default language

An experimental project using Pulumi and Golang to deploy a serverless use-case to Google Cloud Platform ☁️

End to End Data Engineering flow using Fire incidents occurred in US