Disaster Response Message Classifier according to priority and type and ETL/ML Pipeline
-
Updated
Aug 3, 2019 - Python
Disaster Response Message Classifier according to priority and type and ETL/ML Pipeline
Udacity - Data Engineering Nanodegree (Project 1)
Disaster Response Pipeline
Udacity Data Engeneering Nanodegree Program - My Submission of Project: Data Pipelines
Data Modeling with PostgreSQL.
ETL (extract, transform, load) pipeline project that involves extracting data from flat files, manipulating and organizing the data through a series of transformation steps, and loading the resulting data into an SQLite database.
Data engineering project about an ELT process using Apache Airflow and Apache Spark.
An API that uses machine learning to categorise messages received during a crisis.
Used AWS Glue to perform ETL operations and load resultant data to AWS Redshift. In the second phase used AWS CloudWatch rules and LAMBDA to automatically run GLUE Jobs
ETL Pipeline use-case with the batching-processing method
A data processing pipeline to parse the input event files from local and process them based on business requirements and export the output for further analysis and processing.
Personal project that consume Riot's API and stores the data in a data base.
Sample project related to the field of Data Engineering
A project to build an ETL pipeline and ML application to help respond to disaster events faster
Extract stock data via yfinance and ingest into Gsheet
ETL pipeline that collects Reddit posts, applies a sentiment analysis, and publishes selected posts on Slack
Youtube ETL pipeline Project Using Pyspark and AWS
A Python and Spark based ETL framework. While it operates within speed limits that is framework and standards, but offers boundless possibilities.
Add a description, image, and links to the etl-pipeline topic page so that developers can more easily learn about it.
To associate your repository with the etl-pipeline topic, visit your repo's landing page and select "manage topics."