Skip to content

sphinks/argo-singer-template

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 

Repository files navigation

argo-singer-template

A basic example of using Argo Workflows and Singer jobs to create ETL based on Singer taps and target and orchestrated by Argo.

Folder singer - configs for taps and target, Docker file to build an image of Singer job with all possible configs. run.sh - main entry point performing replacing placeholders with config values for a proper config, next starting it.

Folder argo - config for Argo jobs (one per every singer job) and result workflows that will be running both singer jobs daily one by one (Source_2 job depends on the successful finish of Source_1 job).

install_argo_job_kube.sh - this is the way you can replace all your argo jobs in case you host Argo using Kubernetes.

About

Template for create Argo Workflows using Singer ETL

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published