Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added metric representing bytes read from follower #15799

Merged
merged 2 commits into from
Dec 21, 2023

Conversation

mmaslankaprv
Copy link
Member

@mmaslankaprv mmaslankaprv commented Dec 20, 2023

Since it is hard to validate if Follower Fetching feature is working
correctly we add a separate bytes_fetched_from_follower_total metric
that counts bytes that were read from the follower. This will make it
very easy to validate if consumers are reading from the closest replica.

Note: follower fetched bytes are also accounted to overall bytes read.

Important note:
Follower fetched bytes may not be incremented if consumer closest replica is current partition leader.

Fixes: #14814

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v23.3.x
  • v23.2.x
  • v23.1.x

Release Notes

Improvements

  • Added new metric to provide Follower Fetching feature observability

@piyushredpanda
Copy link
Contributor

cc: @tmgstevens

tests/rptest/tests/follower_fetching_test.py Show resolved Hide resolved
src/v/kafka/server/handlers/fetch.h Outdated Show resolved Hide resolved
src/v/cluster/partition_probe.cc Show resolved Hide resolved
Since it is hard to validate if Follower Fetching feature is working
correctly we add a separate `bytes_fetched_from_follower_total` metric
that counts bytes that were read from the follower. This will make it
very easy to validate if consumers are reading from the closest replica.
Note: follower fetched bytes are also accounted to overall bytes read.

Signed-off-by: Michal Maslanka <michal@redpanda.com>
@mmaslankaprv mmaslankaprv force-pushed the ff-metric branch 2 times, most recently from 514a895 to 57d6bcc Compare December 20, 2023 14:57
Signed-off-by: Michal Maslanka <michal@redpanda.com>
@mmaslankaprv mmaslankaprv merged commit f12cd1e into redpanda-data:dev Dec 21, 2023
20 checks passed
@mmaslankaprv mmaslankaprv deleted the ff-metric branch December 21, 2023 06:31
@vbotbuildovich
Copy link
Collaborator

/backport v23.3.x

@vbotbuildovich
Copy link
Collaborator

/backport v23.2.x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Metric for follower-fetching
4 participants