Apache Airflow is the workflow orchestration tool. Airflow is used to build schedule and monitor the data pipelines workflow. Workflow is nothing but a sequence of every task. In Airflow, it is defined as Directed Acyclic Graph. A task is unit of number of operations we want to perform.
-
Notifications
You must be signed in to change notification settings - Fork 0
ShhravyaYerrmal/Data_Pipeline_Using_Airflow
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Twitter data is extracted using ETL data pipelines and Airflow workflows are implemented.