-
Notifications
You must be signed in to change notification settings - Fork 5.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ddl: query since min job id to mitigate slowness due to un-compacted deleted kv #54122
Conversation
Hi @D3Hunter. Thanks for your PR. PRs from untrusted users cannot be marked as trusted with I understand the commands that are listed here. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #54122 +/- ##
=================================================
- Coverage 74.8008% 56.2394% -18.5615%
=================================================
Files 1516 1639 +123
Lines 360897 607115 +246218
=================================================
+ Hits 269954 341438 +71484
- Misses 71336 242373 +171037
- Partials 19607 23304 +3697
Flags with carried forward coverage won't be shown. Click here to find out more.
|
/retest |
@D3Hunter: Cannot trigger testing until a trusted user reviews the PR and leaves an In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
/retest |
@D3Hunter: Cannot trigger testing until a trusted user reviews the PR and leaves an In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
@lance6716 it seems most speedup comes from remove the sub-query inside getJobSQL which i have reverted in this pr as it handles "fair lock" which is changed in your pr #54110. remove this sub-query requires us handle fair across job type, i will file another pr to remove this sub-query i have update the test result in desc, it's 38m33 -> 34m58 now. |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: lance6716, tangenta The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
/retest there is a flaky TestParallelFlashbackTable case, will check it later, #54134, retest first |
@D3Hunter: Cannot trigger testing until a trusted user reviews the PR and leaves an In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
/retest |
@D3Hunter: Cannot trigger testing until a trusted user reviews the PR and leaves an In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
…mpacted deleted kv (pingcap#54122)" This reverts commit a33a868.
What problem does this PR solve?
Issue Number: ref #53246
Problem Summary:
What changed and how does it work?
select
very slow on an empty table fromdelete from xx
#52905. by query since min job id, tikv can directly seek to the starting KV and skip all those that have deleted but not compacted without scanningCheck List
Tests
after #54003 we have optimized create 100K tables under same database on owner node on 1pd/3tidb/3tikv using 10 threads from 50m -> 38m33, as we have reduced the number of query for each job from 2 to 1
after this pr, on same env, it takes 34m58
Side effects
Documentation
Release note
Please refer to Release Notes Language Style Guide to write a quality release note.