Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KAFKA-16810: Add flag to read from specific partitions while checking consumer performance #15905

Open
wants to merge 1 commit into
base: trunk
Choose a base branch
from

Conversation

BOOTMGR
Copy link

@BOOTMGR BOOTMGR commented May 9, 2024

kafka-consumer-perf-test is a great tool to quickly check raw consumer performance. Currently, It subscribes to all the partitions and gives overall cluster performance, however If we want to test performance of single broker/partition, existing tool does not support.

This PR introduces two optional flags --partitions and --offsets which gives flexibility to benchmark only specific partitions optionally from specified offsets.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify documentation (including upgrade notes)
  • Verify test coverage and CI build status

@lianetm
Copy link
Contributor

lianetm commented May 14, 2024

Hey @BOOTMGR, I would expect we need a KIP for this. It brings changes in the command line tool arguments, which is considered a public interface (check KIP page here)

@BOOTMGR
Copy link
Author

BOOTMGR commented May 15, 2024

Hey @BOOTMGR, I would expect we need a KIP for this. It brings changes in the command line tool arguments, which is considered a public interface (check KIP page here)

Thanks for looking into this, I will file KIP.

@BOOTMGR BOOTMGR changed the title MINOR: Add flag to read from specific partitions while checking consumer performance KAFKA-16810: Add flag to read from specific partitions while checking consumer performance May 22, 2024
@BOOTMGR
Copy link
Author

BOOTMGR commented Jul 24, 2024

Hi @lianetm ,
I know the team might be occupied with other important tasks, but I firmly believe this addition would be beneficial. I have filed a KIP [here] and started a discussion thread. Please take a look when you have the time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants