Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

readpool: update yatp and add new metrics for unified-read-pool #13489

Merged
merged 7 commits into from Oct 28, 2022

Conversation

glorv
Copy link
Contributor

@glorv glorv commented Sep 19, 2022

Signed-off-by: glorv glorvs@163.com

What is changed and how it works?

Issue Number: ref #13313

What's Changed:

update yatp and add new metrics for unified-read-pool

Preview of the new metrics:
image
image

Benchmark result:

I use sysbench oltp_read_only(with --range_selects) and select_random_ranges to test the impact of unified-read-pool. The test is running by benchbot with xl cluster(8c48gb) and 200 threads.

The nightly commit is da4877567c0ff11a863d6e39923e8c9819064a57 and the PR's commit is a264b5a5fdd6cf48e17a97db11d9d0d840578041. Each case is running for 15 minutes.

case commit thread tps qps avg lat p99 lat p999 lat
select_random_ranges nightly 200 78902 78890 2.30 7.46 15.1
select_random_ranges this PR 200 80035(+1.4%) 80023(+1.4%) 2.26 7.17 14.6
oltp_read_only nightly 200 4355 69584 2.18 8.73 18.2
oltp_read_only this PR 200 4350 69508 2.19 8.71 18.4

Related changes

  • PR to update pingcap/docs/pingcap/docs-cn:
  • Need to cherry-pick to the release branch

Check List

Tests

  • Unit test
  • Integration test
  • Manual test (add detailed scripts or steps below)
  • No code

Side effects

  • Performance regression
    • Consumes more CPU
    • Consumes more MEM
  • Breaking backward compatibility

Release note

None

Signed-off-by: glorv <glorvs@163.com>
@ti-chi-bot
Copy link
Member

ti-chi-bot commented Sep 19, 2022

[REVIEW NOTIFICATION]

This pull request has been approved by:

  • BusyJay
  • sticnarf

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

@sticnarf
Copy link
Contributor

Is there any data about the performance impact of the newly added metrics?

@glorv
Copy link
Contributor Author

glorv commented Sep 19, 2022

Is there any data about the performance impact of the newly added metrics?

@sticnarf I benchmark this with sysbench with --threads=200 --tables=32 --table_size=50000000 oltp_read_only --range_selects --time=1800:

before after
tps 80316.03 79614.97
avg lat 39.84 40.19
p99 lat 77.19 77.19
max lag 446.35 285.57

The preformance difference is less than 1%, so I think there is no observable performance regression after this change.

@glorv
Copy link
Contributor Author

glorv commented Oct 21, 2022

/release

@glorv
Copy link
Contributor Author

glorv commented Oct 22, 2022

@sticnarf @BusyJay I have updated the benchmark result in the PR description. The result shows the performance is slight better in select_random_ranges and no regression in oltp_read_only.

Copy link
Contributor

@sticnarf sticnarf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-chi-bot ti-chi-bot added the status/LGT1 Status: PR - There is already 1 approval label Oct 25, 2022
@ti-chi-bot ti-chi-bot added status/LGT2 Status: PR - There are already 2 approvals and removed status/LGT1 Status: PR - There is already 1 approval labels Oct 25, 2022
@Connor1996
Copy link
Member

/merge

@ti-chi-bot
Copy link
Member

@Connor1996: It seems you want to merge this PR, I will help you trigger all the tests:

/run-all-tests

You only need to trigger /merge once, and if the CI test fails, you just re-trigger the test that failed and the bot will merge the PR for you after the CI passes.

If you have any questions about the PR merge process, please refer to pr process.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

@ti-chi-bot
Copy link
Member

This pull request has been accepted and is ready to merge.

Commit hash: c3b730f

@ti-chi-bot ti-chi-bot added the status/can-merge Status: Can merge to base branch label Oct 28, 2022
@ti-chi-bot
Copy link
Member

@glorv: Your PR was out of date, I have automatically updated it for you.

At the same time I will also trigger all tests for you:

/run-all-tests

If the CI test fails, you just re-trigger the test that failed and the bot will merge the PR for you after the CI passes.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

@ti-chi-bot ti-chi-bot merged commit dea7b05 into tikv:master Oct 28, 2022
@ti-chi-bot ti-chi-bot added this to the Pool milestone Oct 28, 2022
@glorv glorv deleted the read-pool-metrics branch June 12, 2023 06:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release-note-none size/XL status/can-merge Status: Can merge to base branch status/LGT2 Status: PR - There are already 2 approvals
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants