Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.
-
Updated
Oct 30, 2024 - Python
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.
Dynamically generate Apache Airflow DAGs from YAML configuration files
A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
A Python 3 package for learning Bayesian Networks (DAGs) from data. Official implementation of the paper "DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterization"
causact: R package to accelerate computational Bayesian inference workflows in R through interactive visualization of models and their output.
Bayesian inference from binary causal models
Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows
Use regression, inverse probability weighting, and matching to close confounding backdoors and find causation in observational data
This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow orchestration tool on AWS EC2 instance.
Airflow plugin to create/edit Dags via drag-and-drop on a convenient UI
TheEye supervisor
Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse
This provider contains operators, decorators and triggers to send a ray job from an airflow task
🌱 Concurrently run a set of dependent, asynchronous tasks with type-safe dependencies
Automate your data pipelines using Apache Airflow with this ready-to-use DAG for data integration, ETL and workflow automation.
Udacity Data Engineering Nanodegree Capstone Project
This a repo that was created to learn more about Airflow and develop awesome data engineering projects. 🚀🚀
Add a description, image, and links to the dags topic page so that developers can more easily learn about it.
To associate your repository with the dags topic, visit your repo's landing page and select "manage topics."