Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[C++] Implement batch aware producer router #8395

Merged
merged 5 commits into from
Dec 3, 2020

Conversation

merlimat
Copy link
Contributor

Motivation

Similarly with what we're doing for Java and Go clients, in C++ producer we should apply logic to ensure the round-robin routing is done in a way to maximize the batching factor, by sticking to a partition for a long it takes to fill up a single batch.

@merlimat merlimat added type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages component/c++ labels Oct 28, 2020
@merlimat merlimat added this to the 2.7.0 milestone Oct 28, 2020
@sijie
Copy link
Member

sijie commented Nov 6, 2020

/pulsarbot run-failure-checks

@merlimat merlimat merged commit 74803db into apache:master Dec 3, 2020
@merlimat merlimat deleted the cpp-producer-routing branch December 3, 2020 05:30
@codelipenghui codelipenghui added the cherry-picked/branch-2.7 Archived: 2.7 is end of life label Dec 3, 2020
codelipenghui pushed a commit that referenced this pull request Dec 3, 2020
* [C++] Implement batch aware producer router

* Fixed tests that relied on old rr distribution

* Fixed compilation with older compilers

* Fixed test

(cherry picked from commit 74803db)
RobertIndie pushed a commit to RobertIndie/pulsar that referenced this pull request Dec 8, 2020
* [C++] Implement batch aware producer router

* Fixed tests that relied on old rr distribution

* Fixed compilation with older compilers

* Fixed test
merlimat added a commit to merlimat/pulsar that referenced this pull request Dec 19, 2020
merlimat added a commit to merlimat/pulsar that referenced this pull request Dec 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cherry-picked/branch-2.7 Archived: 2.7 is end of life release/2.7.1 type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants