Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
-
Updated
Jul 12, 2024 - Python
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.
Efficient data transformation and modeling framework that is backwards compatible with dbt.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
dbt + Metabase integration
One framework to develop, deploy and operate data workflows with Python and SQL.
PyAirbyte brings the power of Airbyte to every Python developer.
Singer Target for the Snowflake cloud Data Warehouse
Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).
Spark data pipeline that processes movie ratings data.
The dbt adapter for Firebolt
Add a description, image, and links to the elt topic page so that developers can more easily learn about it.
To associate your repository with the elt topic, visit your repo's landing page and select "manage topics."