Skip to content

Visya/aws-managed-airflow-deployment

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

aws-managed-airflow-deployment

This is an example of MWAA deployment using CloudFormation and GitHub actions.

Architecture

Airflow DAG architecture

Stacks

Infra stack - includes common infrastructure resources that do not need to be deployed often, such as infrastructure and data lake buckets, VPC and internet gateway.

Airflow stack - includes all the resources needed for managed Airflow environment deployment, such as subnet configuration, execution role and policy, and environment itself.

DynamoDbToS3EtlJob stack is an example of DynamoDB to S3 ETL GlueJob.

Deployment

GitHub actions automatically deploys all the CloudFormation stacks for you including Airflow dags and requirements.txt file.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages