Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: Consumer Async Using LibrdKafka poll(Timespan span) method #367

Open
YaliBar opened this issue Mar 1, 2023 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@YaliBar
Copy link

YaliBar commented Mar 1, 2023

Is your request related to a problem you have?

The consumer thread runs on a tenanted k8s node, and the consuming is done using a blocking librdkafka API.
We don't have horizontal scaler, 1 blocked polling Thread for 1 topic consumer model, is a bottleneck for every system.

Describe the solution you'd like

Replace implementation to Async polling, instead of CancelToken and the Sync librdkafka poll

Are you able to help bring it to life and contribute with a Pull Request?

Yes

Additional context

No response

@YaliBar YaliBar added the enhancement New feature or request label Mar 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Development

No branches or pull requests

2 participants