Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kafka: support dynamic quotas #147

Open
rkruze opened this issue Nov 20, 2020 · 7 comments
Open

kafka: support dynamic quotas #147

rkruze opened this issue Nov 20, 2020 · 7 comments
Labels
area/kafka kind/enhance New feature or request

Comments

@rkruze
Copy link
Contributor

rkruze commented Nov 20, 2020

Today we limit based on a per client id, which is a single setting for the whole server. It would be ideal to set a quota on a per-user basis on either byte, requests, or network throughput. This would be similar to how quotas are set in Kafka today. https://kafka.apache.org/documentation/#design_quotasconfig

Some examples of how this is set in Kafka can be found here: https://github.com/JNachtwey/kafka-cheat-sheets/blob/master/kafka-quotas.md

JIRA Link: CORE-576

@rkruze rkruze added the kind/enhance New feature or request label Nov 20, 2020
@dotnwat dotnwat changed the title Dynamic Quotas kafka: dynamic quotas Jul 2, 2021
@dotnwat
Copy link
Member

dotnwat commented Jul 2, 2021

@rkruze now that we have users and ACLs etc... I think we are in a position to schedule this feature work.

@dotnwat dotnwat changed the title kafka: dynamic quotas kafka: support dynamic quotas Jul 2, 2021
@mattschumpert
Copy link

@dotnwat can you verify that there is indeed throttling per client id. This does not appear to be documented and itself is very useful (though per true tenant is of course needed as well)

@mattschumpert
Copy link

NM I found it

@dotnwat
Copy link
Member

dotnwat commented Apr 6, 2024

@michael-redpanda @BenPope seems like we might support per-user quota now, right?

@mattschumpert
Copy link

Still based on Client ID AFAIK, right @BenPope ? I agree this would be super valuable

@michael-redpanda
Copy link
Contributor

We support client ID based but it's per shard rather than node. There's already an issue somewhere to address that

@michael-redpanda
Copy link
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/kafka kind/enhance New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants