Expose user-relevant options in kafka sources/sinks

[nicolaferraro]

I'm thinking to:

• clientId
• autoOffsetReset

But there may be others.

We can use the new optional placeholder for the clientId.

[oscerd]

I think for the source side, it's important to specify the pollOnError option, to specify how to behave in case of fail while polling one message.

[oscerd]

Also allowManualCommit and autoCommitEnable should be exposed in some way.

[nicolaferraro]

Also allowManualCommit and autoCommitEnable should be exposed in some way.

Yes, we should also provide a way to do manual commit in case (e.g. an action).

[nicolaferraro]

I think for the source side, it's important to specify the pollOnError option, to specify how to behave in case of fail while polling one message.

Is there some relation to error handler? cc: @squakez

[oscerd]

It's the default, but you may also specify ignore record and go ahead, retry or reconnect.

[oscerd]

So we can maintain the default but also give freedom to the end user.

[squakez]

I think for the source side, it's important to specify the pollOnError option, to specify how to behave in case of fail while polling one message.

Is there some relation to error handler? cc: @squakez

The errorHandler, if configured by user, is taking over when an exception arise either in the source or the sink. If there is some error managment done by the Kamelet, then, the errorHandler should not be triggered. However it would be good to double check these kind of behaviors.

[oscerd]

So now we have:

• autoCommitEnable
• allowManualCommit
• autoOffsetReset
• pollOnError

For clientId as optional, we need Camel 3.10