-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HBASE-23780 Edit of test classifications #1109
Conversation
💔 -1 overall
This message was automatically generated. |
b423232
to
9d88f13
Compare
💔 -1 overall
This message was automatically generated. |
9d88f13
to
0a440e6
Compare
💔 -1 overall
This message was automatically generated. |
These classifications come of running at various fork counts.. A test may complete quick if low fork count but if it is accessing disk, it will run much slower if fork count is high. This edit accommodates some of this phenomenon.
0a440e6
to
3025458
Compare
Test failures were because of fixes made for checkstyle complaints taking parameter private when should be public. This last push should be in. Would like to get it in. It moves around classfications based off study of tests run w/ current configs and with the upped throughputs that come of higher fork counts (more parallelism). Apart from changes in categories, only other changes are checkstyle complaints. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It moves around classfications based off study of tests run w/ current configs and with the upped throughputs that come of higher fork counts (more parallelism).
Thanks for putting this together. Curious if you did some automation around this (analyzing the test results) to get this data. If so that can probably be checked in too somewhere and we can have a bot that can point the mismatched categories based on test runtime or some other simple rules.
Reason I'm asking this is because it has to be repeated periodically, so wondering if there can be automation around it.
bq. Curious if you did some automation around this (analyzing the test results) to get this data. If so that can probably be checked in too somewhere and we can have a bot that can point the mismatched categories based on test runtime or some other simple rules. None on my part. A bunch of heuristics. Hard to do hard categorization. E.g. small test if < 15 seconds AND does not spin up a cluster of any type. Then for tests that do i/o, their elapsed time can vary wildly dependent on context. Whats here came of study over last few days. Yes, needs to be checked periodically. Something to work on. Thanks for the +1 @bharathv . Let me make sure the qa build comes in clean before merging. |
I see, thanks for the explanation. |
💔 -1 overall
This message was automatically generated. |
Rerun build. Tests pass locally. |
💔 -1 overall
This message was automatically generated. |
A different two failed. Retry. |
💔 -1 overall
This message was automatically generated. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice one, +1
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice one!
Merged. This patch doesn't touch failing test and can't repro locally. Will address in another issue if it persists. Thanks for the reviews all. |
These classifications come of running at various fork counts.. A test may complete quick if low fork count but if it is accessing disk, it will run much slower if fork count is high. This edit accommodates some of this phenomenon. Signed-off-by: Bharath Vissapragada <bharathv@apache.org> Signed-off-by: Viraj Jasani <vjasani@apache.org> Signed-off-by: Jan Hentschel <janh@apache.org>
These classifications come of running at various fork counts.. A test may complete quick if low fork count but if it is accessing disk, it will run much slower if fork count is high. This edit accommodates some of this phenomenon. Signed-off-by: Bharath Vissapragada <bharathv@apache.org> Signed-off-by: Viraj Jasani <vjasani@apache.org> Signed-off-by: Jan Hentschel <janh@apache.org>
These classifications come of running at various fork counts.. A test may complete quick if low fork count but if it is accessing disk, it will run much slower if fork count is high. This edit accommodates some of this phenomenon. Signed-off-by: Bharath Vissapragada <bharathv@apache.org> Signed-off-by: Viraj Jasani <vjasani@apache.org> Signed-off-by: Jan Hentschel <janh@apache.org>
These classifications come of running at various fork counts.. A test may complete quick if low fork count but if it is accessing disk, it will run much slower if fork count is high. This edit accommodates some of this phenomenon. Signed-off-by: Bharath Vissapragada <bharathv@apache.org> Signed-off-by: Viraj Jasani <vjasani@apache.org> Signed-off-by: Jan Hentschel <janh@apache.org>
These classifications come of running at various fork counts.. A test
may complete quick if low fork count but if it is accessing disk, it
will run much slower if fork count is high. This edit accommodates
some of this phenomenon.