Apache Airflow is tool developped by Airbnb that has been in development since 2014 but became really popular 2-3 years after. The goal of this tool is Automate Workflows. Although it is still used for this, it became also commonly used for ETL jobs.
Let's first install Apache Airflow on your local computer. The easiest way is to do it with Docker! We'll be using a docker-compose.yml file that you can copy and paste from the following repository:
$ git clone https://github.com/julientoucoula17/apache_airflow-with-Docker && cd apache_airflow-with-Docker
$ docker-compose up airflow-init
$ docker-compose up