falconeri: Run batch data-processing jobs on Kubernetes
Falconeri runs on a pre-existing Kubernetes cluster, and it allows you to use Docker images to transform large data files stored in cloud buckets.
For detailed instructions, see the Falconeri guide.
Setup is simple:
falconeri deploy falconeri proxy falconeri migrate
Running is similarly simple:
falconeri job run my-job.json