ATD - Airflow Docker Image
This is the airflow image used for Vision Zero ETL processes. To get started, be sure you have docker-compose installed, and run the command below.
Airflow's image is based off of Matthieu "Puckel_" Roisil's docker image: https://github.com/puckel/docker-airflow
To run, Airflow depends on PostgreSQL and Redis (if you run with celery). These components are provided together as a small cluster in docker-compose. The cluster also includes an nginx reverse proxy to centralize web access to airflow's UI and/or any other additional services.
Keep the postgres-data folder empty, docker will try to establish a postgres volume on here to persist its data.
Run Airflow (in detached mode):
From the docker folder:
docker-compose -f docker-compose-localexecutor.yml up -d
Check the Airflow webclient: http://localhost:8080
Stopping the cluster:
docker-compose -f docker-compose-localexecutor.yml down
Read the Docs
Once you have a local instance of Airflow running, you should read the docs folder.