This repo contains the DAGs that run on my local Airflow environment. I use the local environment to test my DAGs before deploying them to virtual machines via Kubernetes
-
Updated
Oct 30, 2022 - Python
This repo contains the DAGs that run on my local Airflow environment. I use the local environment to test my DAGs before deploying them to virtual machines via Kubernetes
Your extensible development environment for data projects with Apache Airflow.
Data pipelines created and monitored using Airflow to feed data into Redshift
Computation as Composable Blocks, can be extended to run on remote pipeline frameworks if necessary.
Automate your data pipelines using Apache Airflow with this ready-to-use DAG for data integration, ETL and workflow automation.
ETL Pipeline : Extract and Transform from sushiscan.su - Load in MongoDB Database
A web services based app
Dagster Directed Acyclic Graphs (DAGs) through Dagster with a simple Machine Learning Program.
Building a personal activity feed with airflow DAGs
A small dag workflow I created using Apache Airflow
Add a description, image, and links to the dags topic page so that developers can more easily learn about it.
To associate your repository with the dags topic, visit your repo's landing page and select "manage topics."