The Data Engineering Cookbook
-
Updated
Jun 11, 2025 - Python
#
data-engineer
Here are 262 public repositories matching this topic...
The best place to learn data engineering. Built and maintained by the data engineering community.
-
Updated
Jun 1, 2025 - CSS
上手简单，无需前端开发的准零代码平台，做轻流/明道本地化的平替产品。
-
Updated
Jun 6, 2025 - Java
Best Data Science, Data Analytics, AI, and SDE roadmaps. This repository is continually updated based on the top job postings on LinkedIn and Indeed in the data science and AI domain.
python data-science artificial-intelligence data-analyst data-engineer data-scientist roadmaps machine-learning-engineer ai-engineer data-science-roadmap ai-scientist nlp-engineer llm-developer computer-vision-engineer
-
Updated
Jun 1, 2025
One framework to develop, deploy and operate data workflows with Python and SQL.
python data-science data sql database pipeline etl analytics snowflake data-warehouse data-structures data-engineering dataops warehouse elt data-pipelines data-engineer trino data-lineage data-engineering-pipeline
-
Updated
May 26, 2025 - Python
A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.
python go docker bigquery google-cloud data-visualization data-pipeline data-engineer firestore prefect cloud-run streamlit
-
Updated
May 25, 2024 - Python
DE직무에 필요한 모든 것
-
Updated
May 22, 2025 - Jupyter Notebook
😎 A curated list of awesome DataOps tools
-
Updated
Oct 14, 2024 - Python
Content for architecting a data science platform for products using Luigi, Spark & Flask.
-
Updated
Jan 27, 2020 - Jupyter Notebook
Projects done in the Data Engineer Nanodegree Program by Udacity.com
airflow spark cassandra etl postgresql jupyter-notebook redshift data-modeling data-engineer cassandra-database udacity-data-engineer-nanodegree data-warehouses data-lakes data-engineer-nanodegree
-
Updated
Dec 8, 2022 - Jupyter Notebook
datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments
-
Updated
Nov 29, 2022 - Python
This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science topics.
python aws data-science machine-learning airflow scala sql big-data spark mongodb hadoop agile etl data-engineering powerbi data-engineer
-
Updated
Jan 18, 2025
The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย
data book data-engineering data-integration hacktoberfest data-pipeline data-engineer data-ingestion data-infrastructure
-
Updated
Oct 28, 2023 - JavaScript
Data Engineering Project with Hadoop HDFS and Kafka
python docker data kafka hadoop docker-compose data-engineering kafka-consumer hdfs kafka-producer hdfs-dfs hadoop-filesystem data-engineer hadoop-hdfs hdfs-client python-hdfs-client pipline data-engineering-pipeline kafka-ui kafkaui
-
Updated
Nov 4, 2023 - Python
For the Coursera specialization https://www.coursera.org/specializations/gcp-data-machine-learning
-
Updated
Nov 22, 2017
Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution
azure data-storage resources data-engineering data-lake azure-storage batch-processing data-engineer azure-data-factory microsoft-azure azure-portal azure-cosmos-db azure-services polybase certification-prep azure-databricks exam-prep azure-certification dp-200 sql-dw
-
Updated
Aug 5, 2020
DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.
-
Updated
Jan 6, 2024 - Jupyter Notebook
Crawls sites, to find new content and scrap it
-
Updated
Apr 20, 2021 - Python
🟣 Data Engineer interview questions and answers to help you prepare for your next machine learning and data science interview in 2025.
data-science machine-learning interview-practice coding-interviews data-engineer interview-preparation technical-interview-questions machine-learning-interview data-science-interview data-scientist-interview software-engineer-interview data-science-interview-questions coding-interview-questions machine-learning-interview-questions ai-interview-questions machine-learning-and-data-science data-engineer-interview-questions data-engineer-questions data-engineer-tech-interview
-
Updated
May 19, 2025
Data Engineering Digest
-
Updated
Jun 24, 2024 - SCSS
Improve this page
Add a description, image, and links to the data-engineer topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-engineer topic, visit your repo's landing page and select "manage topics."