99% of the job is shoveling data from one place to another
Data often arrives in one location or format and needs to be transformed into a different format and location, with new features added along the way. We separate this situation into a few common scenarios:
- Small and Simple: Simple record-by-record or file-by-file transformation, such as can be handled by a simple Python script
- Big: Sometimes we need to transform