Streamsets Spark Transformer
This API can be used in combination with the
in Streamsets Data Collector to apply arbitrary transformations
to a batch of Records using Spark.
An implementation of the
be inserted as an additional library in the SDC's classpath using
the method described here
The Spark Processor is available in several stage libraries, and this
jar should be in the correct library for the specific stage library being used.
Once you have installed the library, start the SDC with the Spark Processor
and specify the Fully Qualified Class Name of the class that implements