Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug in Message Deduplication that may cause incorrect client/broker interaction #5243

Merged
merged 3 commits into from
Sep 24, 2019

Conversation

jerrypeng
Copy link
Contributor

Motivation

Partially fixes #5218

Will be making subsequent PRs to fix issues with handling BK write failures

Modifications

The fix is two-fold:

Double check the pending messages and return error to producer when the dup status is uncertain (eg. message is still pending)
Sync back the lastPushed map with the lastStored map after the failures

@jerrypeng jerrypeng added the type/bug The PR fixed a bug or issue reported a bug label Sep 20, 2019
@jerrypeng jerrypeng added this to the 2.4.2 milestone Sep 20, 2019
@jerrypeng jerrypeng self-assigned this Sep 20, 2019
Copy link
Contributor

@merlimat merlimat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@jerrypeng
Copy link
Contributor Author

rerun java8 tests
rerun integration tests

@aahmed-se
Copy link
Contributor

run integration tests

@jerrypeng
Copy link
Contributor Author

rerun integration tests

@jerrypeng
Copy link
Contributor Author

rerun integration tests

2 similar comments
@jerrypeng
Copy link
Contributor Author

rerun integration tests

@jerrypeng
Copy link
Contributor Author

rerun integration tests

@jiazhai
Copy link
Member

jiazhai commented Sep 24, 2019

run integration tests

@jerrypeng
Copy link
Contributor Author

run integration tests

@merlimat merlimat merged commit 2ad58c4 into apache:master Sep 24, 2019
wolfstudy pushed a commit that referenced this pull request Nov 20, 2019
…nteraction (#5243)

* Bug in Message Deduplication that may cause incorrect behavior

* add tests

* fix error message

(cherry picked from commit 2ad58c4)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/bug The PR fixed a bug or issue reported a bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Enabling Deduplication may drop messages
5 participants