Skip to content

This repository contains an Airflow pipeline to automatically load CSV files into a PostgreSQL database, fully containerized with Docker Compose.

Notifications You must be signed in to change notification settings

babebp/airflow-load-csv-to-postgresql

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

6 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Airflow load csv to postgresql

πŸ“š About This Project

This repository demonstrates how to use Apache Airflow to automate loading CSV files into a PostgreSQL database. It is a simple but powerful data pipeline designed to showcase ETL (Extract, Transform, Load) operations using modern data tools.

βœ… Features:

  • Monitor and schedule CSV ingestion automatically.
  • Load CSV data into PostgreSQL using Airflow DAGs.
  • Fully containerized with Docker Compose for easy local setup.

Create User for Airflow

docker-compose run airflow-webserver airflow users create --role Admin --username airflow --email airflow@example.com --firstname airflow --lastname airflow --password airflow

About

This repository contains an Airflow pipeline to automatically load CSV files into a PostgreSQL database, fully containerized with Docker Compose.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages