Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: fix flakey follower read roachtest #34711

Merged
merged 1 commit into from
Feb 7, 2019

Conversation

ajwerner
Copy link
Contributor

@ajwerner ajwerner commented Feb 7, 2019

The follower read roachtest sustains reads against followers and verifies that
the 90th %-ile latency never exceeds 20ms. During certain situations like lease
transfer, the latency may jump up. This change now runs the sustained reads for
longer (3 minutes instead of 1) and verifies that the latency is low at least
80% of the time. This should be much less fragile.

Fixes #34701.

Release note: None

@cockroach-teamcity
Copy link
Member

This change is Reviewable

@@ -208,7 +208,7 @@ func runFollowerReadsTest(ctx context.Context, t *test, c *cluster) {
// Run reads for 60s which given the metrics window of 10s should guarantee
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Run reads for 60s

The follower read roachtest sustains reads against followers and verifies that
the 90th %-ile latency never exceeds 20ms. During certain situations like lease
transfer, the latency may jump up. This change now runs the sustained reads for
longer (3 minutes instead of 1) and verifies that the latency is low at least
80% of the time. This should be much less fragile.

Fixes cockroachdb#34701.

Release note: None
@ajwerner
Copy link
Contributor Author

ajwerner commented Feb 7, 2019

bors r+

craig bot pushed a commit that referenced this pull request Feb 7, 2019
34711: roachtest: fix flakey follower read roachtest r=ajwerner a=ajwerner

The follower read roachtest sustains reads against followers and verifies that
the 90th %-ile latency never exceeds 20ms. During certain situations like lease
transfer, the latency may jump up. This change now runs the sustained reads for
longer (3 minutes instead of 1) and verifies that the latency is low at least
80% of the time. This should be much less fragile.

Fixes #34701.

Release note: None

34721: server: remove timeout from the problem ranges page r=andreimatei a=andreimatei

This page was using an arbitrary timeout of 3s which was proving
insufficient for a user. Not particularly surprising, since the report
performs RPCs which need to iterate through all the ranges.
No more timeout.

Fixes #34311

Release note: None

Co-authored-by: Andrew Werner <ajwerner@cockroachlabs.com>
Co-authored-by: Andrei Matei <andrei@cockroachlabs.com>
@craig
Copy link
Contributor

craig bot commented Feb 7, 2019

Build succeeded

@craig craig bot merged commit b490469 into cockroachdb:master Feb 7, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants