Skip to content

Simple script to deploy airflow dags for any project in zip or flat file format.

Notifications You must be signed in to change notification settings

SubigyaPanta/airflow-dag-deployer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Installation

pip install airflow-dag-deployer

Deploy dags with commandline

Dags can be deployed as zip archive or independent python file prefixed by project name.

Deploying dags as a zip archive

deploydag --project=<project_name> --source=<dags_dir> --destination=<airflow_home> --method=zip

Deploying dags as a file

deploydag --project=<project_name> --source=<dags_dir> --destination=<airflow_home> --method=file

Deploying dags with config file for different environments

Set up of different deployment environment (dev/test/prod)

Have a deploydag.json (or any filename with json setting) file like this:

{
  "dev": {
    "project": "testproject",
    "source": "dags",
    "destination": "airflowhome",
    "method": "zip"
  }
}

Run command like this:

deploydag --config=deploydag.json --env=dev

About

Simple script to deploy airflow dags for any project in zip or flat file format.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages