-
Notifications
You must be signed in to change notification settings - Fork 25.6k
Unmute flaky csv-spec tests with more logging on warnings context #137089
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unmute flaky csv-spec tests with more logging on warnings context #137089
Conversation
These tests do not reproduce, even with reported random seeds. We are unmuting them in the hope that the additional logging will bring some clarity to the situation under which they fail.
|
Pinging @elastic/es-analytical-engine (Team:Analytics) |
| contextBuilder.append("...(truncated)"); | ||
| } | ||
| contextBuilder.append("\n"); | ||
| return contextBuilder.toString(); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just in case you're wondering, I've tested this multiple times by deliberately messing with the tests expected warnings, and I do see meaningful stuff being printed here in the error messages. Whether that will clarify the flakiness or not is yet to be seen.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This change unmutes 6 muted tests and adds additional context to several
warning assertions as described.
💔 Backport failed
You can use sqren/backport to manually backport by running |
…astic#137089) These tests do not reproduce, even with reported random seeds. We are unmuting them in the hope that the additional logging will bring some clarity to the situation under which they fail.
|
Manual backport at #137107 |
…astic#137089) These tests do not reproduce, even with reported random seeds. We are unmuting them in the hope that the additional logging will bring some clarity to the situation under which they fail.
These tests do not reproduce, even with reported random seeds. We are unmuting them in the hope that the additional logging will bring some clarity to the situations under which they fail.
Of note is that there are 186 tests that have warnings specified, but only 8 issues reported grouped into the following test classes:
Five of the eight were related to parsing invalid geospatial types, the other three were change_point, fuse and space-negative.
Six of the eight were reported on main:
Fixes #136249
Fixes #135455
Fixes #134635
Fixes #134254
Fixes #134104
Fixes #133334
Two issues were only muted on 9.2, so we should unmute in the backport: #136285 and #136068