Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Cassandra sink - resiliency #85
Seeing this error and failing to recover/restart.
The cause is most likely due to bad messages coming into kafka from the source - which could be difficult to check for every message.
Is there any thought/likelihood-if-so to build some resiliency e.g. w/ a -k flag to keep continuing inspite of errors and maintain such error counts in a management/oamp interface?
(or if there is a workaround to restart and continue?)
org.apache.kafka.connect.errors.DataException: Failed to deserialize data to Avro:
This error has nothitng to do with the resilience and recoverability of the sink. The error happens before the code execution is handed over to the sink code, in the conversion from the raw bytes to an avro record and then to a Struct .