A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.

Example repository showing how to build a data platform with Prefect, dbt and Snowflake

Make sense of it all. Semantic data modeling and analytics with a sprinkle of AI. https://totalhack.github.io/zillion/

A simple pipeline infrastructure with ETL pipeline contained in a Docker environment on Apache Airflow for orchestration and Postgres for data warehousing

Sparkify Data Warehouse Project for song play analysis

Save data from Instagram takeout to a SQLite database

UWA CITS3401 Data Warehousing Project Semester 1 2019

⭕️ Capstone project for Udacity's Data Engineering Nanodegree

A Data Warehousing project for retail sales using dimension modelling best practices with SCD type 2 on AWS Redshift. Utilizing AWS Lambda, Glue Workflows and Python Shell jobs to create and automate an ELT pipeline where batch data coming into S3 is loaded onto Redshift and necessary transformations are performed to meet requirements.

Sparkify - AWS Redshift Data Warehousing - Udacity Data Engineering Expert Track.

This repository contains code for building a Data Warehouse from scratch. I started with the elicitation process, then used functional dependencies for conversion to GOM4DW schema, followed by conversion to Star Schema to find out different facts and dimensions and lastly I implemented the ETL process. I have used HTML and flask to provide a use…

End-to-end data engineering processes for the NIGERIA Health Facility Registry (HFR). The project leveraged Selenium, Pandas, PySpark, PostgreSQL and Airflow

Ongoin course: Data warehousing (BigQuery) | Batch processing (Airflow, Spark) | Analytics engineering (DBT) | Stream processing (Kafka)

Open-source Twitter collection and archiving tool for tracking specific topics and collecting bulk data.

Universidade do Minho - 4º ano

This project was done at the University of Pisa in collaboration with my colleagues Federica Guiducci and Valentina Olivotto under supervision of professors Anna Monreale and Roberto Pellungrini. It is a Data Warehousing project featuring the use of Analytic SQL and various other tools such as Visual Studio in MS Azure, Microstrategy and Power BI..

Airbnb Analytics Engineering and Data Warehousing Project

This project is implemented in Python and uses Airflow, MySQL Workbench, Apify and Power BI.

Effortlessly analyze YouTube data using Python, SQL, MongoDB, and Streamlit. This repository provides a user-friendly application for retrieving, saving, and querying YouTube channel and video data. Enhance your analytics with Google API integration and uphold ethical data scraping practices.

With the help of this repository you can evaluate my professional level. Everything I know about Data Engineering is stored here.