Consider Flowman

[kupferk]

I am the main author of Flowman (https://flowman.io and https://github.com/dimajix/flowman), and would highly appreciate if Flowman was part of your awesome list.

Flowman is a build tool for data (conceptually similar to dbt, but otherwise unrelated) built on top of Apache Spark. The initial idea of Flowman was to provide an alternative to the classical development approach of a Spark application for data transformations. It takes away the burden of boiler plate code and let data engineers focus on the logic using a purely declarative approach. Nevertheless missing functionality can be implemented in Scala as plugins (or developers can directly contribute to Flowman via guthub).

I am not entirely sure if Flowman is acceptable from your point of view, since I assume that (unfortunately) none of the awesome spark committers ever worked with it. But I'd be very happy if you take a couple of minutes for consideration.