KafkaStreamWriter should not be dependent on Abris (confluent and Avro)
Thus, the encoding part should be extracted to a preceding transformer component
A new transformer should be created, e.g. za.co.absa.hyperdrive.ingestor.implementation.transformer.avro.ConfluentAvroEncoderTransformer
Breaking changes
Configuration properties will need to be adjusted
How to migrate Hyperdrive-Trigger
- Replace
with
"component.transformer.id.2=confluent.avro.encoder", "component.transformer.class.confluent.avro.encoder=za.co.absa.hyperdrive.ingestor.implementation.transformer.avro.ConfluentAvroEncoderTransformer",
"component.writer
- Replace
with
transformer.confluent.avro.encoder.schema
- Replace
with
transformer.confluent.avro.encoder.value
- Replace
writer.kafka.produce.keys
with
transformer.confluent.avro.encoder.produce.keys
- Replace
with
transformer.confluent.avro.encoder.key
- Replace
with
transformer.confluent.avro.encoder.option
KafkaStreamWriter should not be dependent on Abris (confluent and Avro)
Thus, the encoding part should be extracted to a preceding transformer component
A new transformer should be created, e.g.
za.co.absa.hyperdrive.ingestor.implementation.transformer.avro.ConfluentAvroEncoderTransformerBreaking changes
Configuration properties will need to be adjusted
How to migrate Hyperdrive-Trigger
with
with
with
with
with
with