Welcome to conbot!. Conbot is a utility intended to deal with the rougher corners of data engineering. The more mundane, the better conbot is at it!.
For example
- file format conversion (especially gzip)
- schema detection
- data generation
- transfer and transform between clouds and technologies
It is built to perform the "heavy lifting" of common tasks a data engineer may conduct, to be simple, small and as fast as possible. It can be used as terminal tool on a daily basis through to running horizontally in k8s clusters for parallel processing.
Installation instructions are in the INSTALLATION.md
Installation and usage is covered in the USER_GUIDE.md
Conbot is open-source! - you are very welcome to extend it or participate as a commiter. Read the DEVELOPER_GUIDE.md for more information.