Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v23.3.x] Improve throughput throttling #16848

Merged
merged 5 commits into from
Mar 14, 2024

Conversation

BenPope
Copy link
Member

@BenPope BenPope commented Mar 4, 2024

Backport of PR #16441
Fixes: #16815

@BenPope BenPope added the kind/backport PRs targeting a stable branch label Mar 4, 2024
@BenPope BenPope added this to the v23.3.x-next milestone Mar 4, 2024
@BenPope BenPope self-assigned this Mar 4, 2024
@BenPope BenPope force-pushed the backport-16441-v23.3.x branch 2 times, most recently from 0edfbe5 to d628e41 Compare March 4, 2024 13:13
Signed-off-by: Ben Pope <ben@redpanda.com>
(cherry picked from commit bd42479)

Conflicts:
  src/v/ssx/sharded_ptr.h (header include)
  src/v/ssx/tests/sharded_ptr_test.cc (includes)
Refactor only, no functional change.

Signed-off-by: Ben Pope <ben@redpanda.com>
(cherry picked from commit 20ca50a)
New metrics:
* `traffic_egress` - mirrors `traffic_intake`
* `throttle_time` - Histogram of throttle time requested

Signed-off-by: Ben Pope <ben@redpanda.com>
(cherry picked from commit 679804c)
Signed-off-by: Ben Pope <ben@redpanda.com>
(cherry picked from commit 55d8952)
When `kafka_throughput_throttling_v2` is enabled (true by default),
use an `ss::internal::shared_token_bucket` for requests across all
shards, instead of balancing quota between shards.

Signed-off-by: Ben Pope <ben@redpanda.com>
(cherry picked from commit 6ddfb32)

Conflicts:
  src/v/kafka/server/snc_quota_manager.h (header include)
Copy link
Contributor

@michael-redpanda michael-redpanda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Compared with original PR and looks good

@BenPope BenPope marked this pull request as draft March 11, 2024 15:30
@michael-redpanda michael-redpanda dismissed their stale review March 11, 2024 15:31

Dismissing review to wait for testing, but I'm good with this

@piyushredpanda piyushredpanda modified the milestones: v23.3.x-next, v23.3.8 Mar 14, 2024
@BenPope BenPope marked this pull request as ready for review March 14, 2024 14:30
@BenPope BenPope merged commit 8497731 into redpanda-data:v23.3.x Mar 14, 2024
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/redpanda kind/backport PRs targeting a stable branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants