Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KeyShared dispatcher on non-persistent topics was not respecting consumer flow-control #11692

Merged

Conversation

merlimat
Copy link
Contributor

Motivation

Fixes #10734

The KeyShared dispatcher for non-persistent topics is not taking the flow control advertised by consumers to apply back pressure from consumer. That results in broker in pushing messages to consumer without restriction, causing memory issue in consumers.

@merlimat merlimat added type/bug The PR fixed a bug or issue reported a bug release/2.8.1 labels Aug 17, 2021
@merlimat merlimat added this to the 2.9.0 milestone Aug 17, 2021
@merlimat merlimat self-assigned this Aug 17, 2021
@codelipenghui codelipenghui merged commit 5835fd2 into apache:master Aug 18, 2021
@merlimat merlimat deleted the fix-oom-with-non-persistent-dispatcher branch August 18, 2021 01:24
codelipenghui pushed a commit that referenced this pull request Aug 19, 2021
…umer flow-control (#11692)

### Motivation

Fixes #10734

The KeyShared dispatcher for non-persistent topics is not taking the flow control advertised by consumers to apply back pressure from consumer. That results in broker in pushing messages to consumer without restriction, causing memory issue in consumers.

(cherry picked from commit 5835fd2)
@codelipenghui codelipenghui added the cherry-picked/branch-2.8 Archived: 2.8 is end of life label Aug 19, 2021
@marcoguest
Copy link

Hi @merlimat @codelipenghui , could you please confirm if this fix will be into 2.8.1 release? When this one will be available?
Thank you

@merlimat
Copy link
Contributor Author

@marcoguest Yes, this is getting included in 2.8.1 which is scheduled to get release in a few days

@marcoguest
Copy link

Thank you @merlimat

bharanic-dev pushed a commit to bharanic-dev/pulsar that referenced this pull request Mar 18, 2022
…umer flow-control (apache#11692)

### Motivation

Fixes apache#10734

The KeyShared dispatcher for non-persistent topics is not taking the flow control advertised by consumers to apply back pressure from consumer. That results in broker in pushing messages to consumer without restriction, causing memory issue in consumers.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cherry-picked/branch-2.8 Archived: 2.8 is end of life release/2.8.1 type/bug The PR fixed a bug or issue reported a bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Pulsar C++ key-shared subscriber runs out of memory for non-persistent topic
3 participants