This is a package for starting, monitoring and stopping GCP dataflow jobs. It uses a CloudSQL Postgres database to retain a list of jobs for progress tracking.
| File | Purpose |
|---|---|
| schema/ | Postgres db creation scripts |
| jobdef/ | Example dataflow pipeline options json config file |
| dfmgr.go | Logic manager |
| dfmgr_test.go | Tests |
| pgmgr.go | Postgres logic manager |
| pgmgr_test.go | Tests |
| pgdatamgr.go | Data repo interface |
| File | Purpose |
|---|---|
| config.go | Boot package parameters, environment var collection |
| const.go | Package constants |
| entity.go | Package structs |
| env | Package environment variables for local/dev installation |
| gogets | Statements for go-getting required packages |