Task Orchestration using Directed Acyclic Graphs
-
Updated
Sep 21, 2023 - Python
Task Orchestration using Directed Acyclic Graphs
Introduction to Apache Airflow
This dataset contains information about the customer and its location. You can use this dataset to identify unique customers in the order dataset and find the delivery location of orders.
To provide an introduction and demos in Google Cloud Platform Airflow Composer
Data pipeline with Apache Airflow - Data Engineering Nanodegree (DEND) 5th Project
Use of Apache Airflow to backfill and schedule the load and analysis of raw data into Redshift data warehouse
This data pipeline project focuses on ingesting and processing raw stock market data, performing feature engineering on top of the processed data, training a predictive model, and building an API service to serve the trained model.
Implementation of Different Advanced Algorithms
Lightweight, accessible composite data structures for Python
An extension enabling the monitoring of Apache Airflow DAGs directly from Jupyter notebooks. Tailored for developers and data scientists, it simplifies tracking specific DAGs, reduces unnecessary friction, and allows severity levels setup for failed DAGs.
A simple DataOps for wine dataset on Docker
Works completed within the Airflow module of the Data Analyst course on the Karpov Courses platform
automated data pipeline using beautiful soup, apache airflow and dvc data versioning
Add a description, image, and links to the dag topic page so that developers can more easily learn about it.
To associate your repository with the dag topic, visit your repo's landing page and select "manage topics."