Pinned Loading

1. USImmigrationDataLakeETL USImmigrationDataLakeETL Public

   The project aims to create a data lake for US immigration data and developing an ETL pipeline to build this data lake using data from various sources. The project was completed as a part of Udacity…

   Jupyter Notebook 1

2. DataPipelinesWithAirflow_Udacity DataPipelinesWithAirflow_Udacity Public

   Created the DAGs and designed an ETL pipeline using custom operators to perform tasks such as staging the data, filling the data warehouse, and running checks on the data as the final step. This pr…

   Python

3. FrequentPatternMining FrequentPatternMining Public

   Comparative study of frequent pattern mining algorithm on Adult Census Data

   Jupyter Notebook

4. DataWarehousingOnAWS_Udacity DataWarehousingOnAWS_Udacity Public

   This project builds a data warehouse using Amazon Redshift and S3, and was completed as a part of Udacity's Data Engineering Nanodegree program.

   Python

5. DataLakeWithSpark_Udacity DataLakeWithSpark_Udacity Public

   This project creates a data lake using AWS S3, EMR and Spark to build an ETL pipeline for a music database.

   Python

6. DataModelingWithApacheCassandra_Udacity DataModelingWithApacheCassandra_Udacity Public

   Modeled song data using Apache Cassandra and designed an ETL pipeline.

   Jupyter Notebook