Skip to content

run airflow on kubernetes for historical processing

Notifications You must be signed in to change notification settings

flix-tech/k8s-airflow

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Aiflow on Kubernetes

This is a project to a airflow app on Kubernetes. More information here.

run app locally

Install local Kubernetes cluster first. Use minikube.

Install task build tools task.

Run locally:

task run.local

Undeploy locally:

task airflow.undeploy

deploy on EKS Kubernetes cluster

First you need to deploy manually the service account and rolebindings:

#First login into your k8s namespace
kubectl -n $NAMESPACE apply -f k8s/rolebinding.yaml

About

run airflow on kubernetes for historical processing

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published