One framework to develop, deploy and operate data workflows with Python and SQL.
-
Updated
Aug 21, 2024 - Python
One framework to develop, deploy and operate data workflows with Python and SQL.
A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.
😎 A curated list of awesome DataOps tools
Crawls sites, to find new content and scrap it
datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments
Code, Examples, Templates and Scripts for DataWorksSummit 2017 Sydney Talk
Wraps the DB by opening a REST API for storing and retrieving documents info & recommendations
A data engineering platform for maintaining a data ecosystem to support self-driving cars research.
Data Engineering Project with Hadoop HDFS and Kafka
End-to-end data engineering processes for the NIGERIA Health Facility Registry (HFR). The project leveraged Selenium, Pandas, PySpark, PostgreSQL and Airflow
Repositório dedicado ao desafio do hackathon de engenharia de dados A3 Data Challenge Woman
The Real-time Ecommerce Data Collection and Processing project empowers businesses with real-time insights by efficiently extracting, processing, and storing ecommerce data from multiple sources. Combining Golang and Python, this cutting-edge solution streamlines data handling from diverse ecommerce websites.
IGTI MBA Engenharida de dados - Bootcamp Engenheiro de Dados Cloud - Desafio final
Personal Data Engineering project witch the objective is create the Data Lakehouse for a B2B e-commerce that must store the transactional and analytical data of the business. The final system delivers structured and clean data with the purpose of generate reports and find opportunities.
Prefect - Data orchestration tool practice & learning
Nexus is a distributed workflow system designed for use by data engineers to move data around their organisations.
Python example using Pandas to load CSV into a local SQLite DB.
Add a description, image, and links to the data-engineer topic page so that developers can more easily learn about it.
To associate your repository with the data-engineer topic, visit your repo's landing page and select "manage topics."