A portable Datamart and Business Intelligence suite built with Docker, Mage, dbt, DuckDB and Superset

End-to-end data engineering project

Data modeling and ETL pipeline for data analytics on Uber dataset using Google cloud storage, BigQuery, and Looker Studio

Solutions for @DataTalksClub's Data Engineering Zoomcamp 2024.

A data engineering project built around Smogon's Stats API.

Personal project for Data Engineering Zoomcamp

A quick analysis of Yellow Taxi cabs riding in New York 2022

Developed an interactive dashboard utilizing Google Looker Studio to analyze Uber usage patterns in NYC. Designed a robust data model and implemented an efficient data pipeline using Mage AI on GCP's VM infrastructure. Utilized Google BigQuery for in-depth analytics and leveraged Google Cloud Platform for data processing.

Data Engineering on GCP and Mage AI

Engineered a robust data pipeline using Google Cloud Platform (GCP) services like Cloud Storage, Compute Engine, BigQuery, resulting in a 30% decrease in data processing and analysis time of the San Francisco Crime dataset.Designed an interactive dashboard using Looker Studio, empowering stakeholders to explore crime data visually.

Performed data analytics on Uber data using various tools and technologies, including GCP Storage, Python, Compute Instance, Mage Data Pipeline Tool, BigQuery, and Looker Studio.

A full data pipeline project. from the ETL to the Dashboard

Data Engineering Pipeline for Uber Data Analysis using Google Cloud Platform, Mage-AI and Looker

Engineered a robust data pipeline using Google Cloud Platform (GCP) services like Cloud Storage, Compute Engine, BigQuery, resulting in a 30% decrease in data processing and analysis time of the San Francisco Crime dataset.Designed an interactive dashboard using Looker Studio, empowering stakeholders to explore crime data visually.

An end to end Data Engineering Project

This project showcases a data engineering pipeline using Google Cloud Platform (GCP) for analyzing taxi trips data from New York City. The pipeline includes steps such as data collection, storage setup, ETL processing, database creation, and data visualization.

Data Engineering Zoomcamp 2024

An end-to-end data engineering project using Amazon S3, EC2, mage.io, Google BigQuery and Looker.