Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: assert limit capacity throughput 90% of baseline #119652

Merged

Conversation

kvoli
Copy link
Collaborator

@kvoli kvoli commented Feb 26, 2024

This commit enables a throughput assertion on the limit_capacity
roachtests. The assertion requires that throughput after limiting some
nodes capacity is at least 90% of the pre-limit throughput after 2
minutes.

Part of: #118866
Release note: None

@cockroach-teamcity
Copy link
Member

This change is Reviewable

@kvoli kvoli self-assigned this Mar 4, 2024
@kvoli kvoli marked this pull request as ready for review March 4, 2024 21:20
@kvoli kvoli requested a review from a team as a code owner March 4, 2024 21:20
@kvoli kvoli requested review from srosenberg and renatolabs and removed request for a team March 4, 2024 21:20
@kvoli kvoli force-pushed the 240226.roachtest-limit-capacity-assertions branch from f81c1cb to 3c95a3d Compare March 4, 2024 22:08
@kvoli kvoli requested a review from andrewbaptist March 4, 2024 22:08
@kvoli
Copy link
Collaborator Author

kvoli commented Mar 4, 2024

Requires #119776 to pass.

Copy link
Collaborator

@andrewbaptist andrewbaptist left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Why did you drop the limit duration? Shouldn't it work with 2 minutes also?

@kvoli
Copy link
Collaborator Author

kvoli commented Mar 28, 2024

Why did you drop the limit duration? Shouldn't it work with 2 minutes also?

The 2 minutes felt too generous. I'm re-running some tests now to confirm the minute is reasonable.

@kvoli
Copy link
Collaborator Author

kvoli commented Mar 28, 2024

Current results off master:

image

@kvoli
Copy link
Collaborator Author

kvoli commented Mar 28, 2024

Vs without shedding

image

This commit enables a throughput assertion on the `limit_capacity`
roachtests. The assertion requires that throughput after limiting some
nodes capacity is at least 90% of the pre-limit throughput after 2
minutes.

Part of: cockroachdb#118866
Release note: None
@kvoli kvoli force-pushed the 240226.roachtest-limit-capacity-assertions branch from 3c95a3d to d8f2742 Compare March 28, 2024 19:13
@kvoli
Copy link
Collaborator Author

kvoli commented Mar 28, 2024

Failed 1/10 runs for the compact=0 variety. No failures for write_b=25mb variety over 10 runs.

The failure was simply due to slower L0 sublevel growth than the other runs. I'll leave the period at 2 minutes.

@kvoli
Copy link
Collaborator Author

kvoli commented Mar 28, 2024

TYFTR

bors r=andrewbaptist

@kvoli kvoli added the backport-24.1.x Flags PRs that need to be backported to 24.1. label Mar 28, 2024
@craig craig bot merged commit 5470a6b into cockroachdb:master Mar 28, 2024
36 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-24.1.x Flags PRs that need to be backported to 24.1.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants