New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FLINK-20194][connector/kafka] Fix the KafkaSourceReader offset commit. #14142
Conversation
Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community Automated ChecksLast check on commit 92b26cf (Thu Nov 19 17:56:17 UTC 2020) Warnings:
Mention the bot in a comment to re-run the automated checks. Review Progress
Please see the Pull Request Review Guide for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commandsThe @flinkbot bot supports the following commands:
|
92b26cf
to
8d070ee
Compare
@flinkbot run azure |
I looked at the API change of the base connector, and it seems reasonable. |
… of SplitId -> SplitState.
8d070ee
to
d280fa2
Compare
@flinkbot run azure |
…ng cases: 1. The SplitFetcher has exited. 2. The offsets to be committed is empty. 3. The offsets commit for finished splits.
d280fa2
to
78807d6
Compare
merged to master. |
What is the purpose of the change
The patch fixes the offsets commit in the following cases:
1. The SplitFetcher has exited.
2. The offsets to be committed is empty.
3. The offsets commit for finished splits.
Brief change log
Verifying this change
The unit tests has been added to
KafkaSourceReaderTest
.Does this pull request potentially affect one of the following parts:
@Public(Evolving)
: (yes, the argument passed toSourceReaderBase.onSplitFinish()
has changed)Documentation