Geospatial data hoarding system

Among the beginning steps for Data Analyis, Data Preparation plays an important role to have clean, error free, clear formatted dataset to train/test the model on.

Store SARS-CoV-2 genomic analysis results from ncov2019-artic-nf and ncov-tools to a sqlite DB

Udacity Data Engineering Capstone project

Student project #1 - Web scraping, use Python basics to create a program that automate the process of extracting, transform and load data from the online library "Books to Scrape".

PRE-ALPHA - Write web crawlers using Bonobo

Python module for extracting, transforming and loading data

PREVIEW - Run Bonobo data processing graphs in docker containers.

PREVIEW - SQL databases in Bonobo, using sqlalchemy

open-source ETL pipeline for HEX cryptocurrency data

Final Code from the CHM090 Efficacy Project

This repository contains code for comparing the performance of three different ELT (Extract, Load, Transform) methods on CSV files of different sizes. The three methods are implemented in Python using different approaches and libraries, and their execution times are compared and plotted for analysis.

Extract Transform Load for Python 3.5+

NYC TLC Data Analysis using Python, GCP Storage, Compute Engine, Mage Data Pipeline Tool, BigQuery, and Looker Studio. Aims to extract insights from the dataset for informed decisions and deeper operational understanding.

This is an Extract, Transform, Load (ETL) project of unstructured Airline Billing and Settlement Plans (BSP) data

Domain : Social Media | Extracting data using Youtube API and storing it on MongoDB then Transforming it to a relational databaselike MySQL. For getting various info about youtube channels.

Extract, Transform, and Load script for fetching new data from the NYC Open Data Portal's vehicle collision data and loading into the NYC Crash Mapper table on CARTO.

A bundle for zipline-reloaded to allow data for crypto assets to be ingested from Tardis

Developed a Streamlit application for analyzing transactions and user data from the Pulse dataset. Explored data insights on states, years, quarters, districts, transaction types, and brands through EDA. Visualized trends and patterns using plots and charts to optimize decision-making in the Fintech industry.

This Twitter ETL project is aimed at providing data to support UN SDG number 16. The project is directed at providing data to generate actionable insights to stakeholders; regarding the 2022 Presidential Elections, Police Brutality, and Propagation of Hate Speech on Twitter