-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[improve][connector] Add getSourceConfig method on SourceContext. #16305
Conversation
@nlu90 @freeznet @codelipenghui Please help review it, thanks. |
Do you mean add it to |
Yes. |
^^ The PR is good, but the description has some typo. change |
Sorry, I changed. |
--- *Motivation* Pulsar has added the new method into the SourceContext and SinkContext. Which will break the current code with the implementation. Adding the related implementation to avoid building failed. apache/pulsar#15482 apache/pulsar#16305 *Modification* - Adding the realted implementation to the class
--- *Motivation* Pulsar has added the new method into the SourceContext and SinkContext. Which will break the current code with the implementation. Adding the related implementation to avoid building failed. apache/pulsar#15482 apache/pulsar#16305 *Modification* - Adding the realted implementation to the class
--- *Motivation* Pulsar has added the new method into the SourceContext and SinkContext. Which will break the current code with the implementation. Adding the related implementation to avoid building failed. apache/pulsar#15482 apache/pulsar#16305 *Modification* - Adding the realted implementation to the class (cherry picked from commit c62df08)
Motivation
The configuration of SourceConfig is rich, and the user can flexibly specify it when registering the source. But some sources do not support these configurations. For example, some sources do not support
EFFECTIVELY_ONCE
guarantees, because the upstream system cannot generate ordered sequence id.So, add the
getSourceConfig
method to SourceContext, enables the source to validate the configuration when executing thesource.open
method.Modifications
Documentation
doc-not-needed