This repository demonstrates how to use Apache Airflow to automate loading CSV files into a PostgreSQL database. It is a simple but powerful data pipeline designed to showcase ETL (Extract, Transform, Load) operations using modern data tools.
- Monitor and schedule CSV ingestion automatically.
- Load CSV data into PostgreSQL using Airflow DAGs.
- Fully containerized with Docker Compose for easy local setup.
docker-compose run airflow-webserver airflow users create --role Admin --username airflow --email airflow@example.com --firstname airflow --lastname airflow --password airflow