Apache Airflow

From: https://airflow.apache.org/docs/apache-airflow/stable/howto/docker-compose/index.html And About OAuth: https://awslife.medium.com/airflow-authentication-with-rbac-and-keycloak-2c34d2012059

Guide

Initializing Environment

Setting the right Airflow user

mkdir -p ./dags ./logs ./plugins
echo -e "AIRFLOW_UID=$(id -u)" > .env

Initialize the database

docker compose up airflow-init

Running Airflow

docker-compose up

Shuld now run at http://localhost:8080