Apache Airflow using Docker Compose
Im using the taskfile build tool to simplify usage. But running without taskfile,
To build the dependency image:
docker-compose -f deps.docker-compose.yml build
Once the airflow-dependencies:1.10.14 image is built, you can build the rest and start the containers:
docker-compose up --build -d
Im using the taskfile build tool to simplify usage.
To install on a mac:
brew install go-task/tap/go-task
To install on linux:
sh -c "$(curl --location https://taskfile.dev/install.sh)" -- -d -b /usr/local/bin
Then for help run:
task
task: Available tasks for this project:
* build: Builds airflow
* clean: Runs docker system prune -f --all
* default: Runs the help task
* down: Stops containers
* help: Runs the list tasks
* logs: Runs docker-compose logs -f
* run: Runs docker-compose up -d
* verify: Verify if docker is running
To build and start:
task build
task run
The default username is admin and the password is password but configurable on the environment variable AIRFLOW_ADMIN_PASSWORD.
Airflow:
Flower:
Airflow UI:
Graph View:
Flower Dashboard:
Detail about the worker:
Executed Tasks:
Broker:
