-
Notifications
You must be signed in to change notification settings - Fork 17.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
runtime: frequent TestCrashDumpsAllThreads failures on linux/s390x
#64650
Comments
Found new dashboard test flakes for:
2023-12-02 03:15 linux-s390x-ibm-race go@de5b418b runtime.TestCrashDumpsAllThreads (log)
2023-12-04 18:17 linux-s390x-ibm-race go@92b6cdeb runtime.TestCrashDumpsAllThreads (log)
2023-12-04 18:40 linux-s390x-ibm go@1926a0b5 runtime.TestCrashDumpsAllThreads (log)
2023-12-04 18:40 linux-s390x-ibm-race go@1926a0b5 runtime.TestCrashDumpsAllThreads (log)
2023-12-05 20:34 linux-s390x-ibm-race go@c29444ef runtime.TestCrashDumpsAllThreads (log)
2023-12-05 22:42 linux-s390x-ibm-race go@53393062 runtime.TestCrashDumpsAllThreads (log)
2023-12-05 22:42 linux-s390x-ibm go@ba519019 runtime.TestCrashDumpsAllThreads (log)
2023-12-06 13:10 linux-s390x-ibm-race go@e4182589 runtime.TestCrashDumpsAllThreads (log)
2023-12-06 19:29 linux-s390x-ibm-race go@7b5a3733 runtime.TestCrashDumpsAllThreads (log)
2023-12-06 21:39 linux-s390x-ibm-race go@71fc9d4d runtime.TestCrashDumpsAllThreads (log)
2023-12-06 21:50 linux-s390x-ibm go@3b8b550a runtime.TestCrashDumpsAllThreads (log)
2023-12-06 21:50 linux-s390x-ibm go@ff9269ee runtime.TestCrashDumpsAllThreads (log)
2023-12-06 21:50 linux-s390x-ibm go@e914671f runtime.TestCrashDumpsAllThreads (log)
2023-12-06 21:59 linux-s390x-ibm go@fecaea97 runtime.TestCrashDumpsAllThreads (log)
2023-12-06 23:34 linux-s390x-ibm go@2b442575 runtime.TestCrashDumpsAllThreads (log)
2023-12-07 01:05 linux-s390x-ibm go@5e724ccb runtime.TestCrashDumpsAllThreads (log)
2023-12-07 01:05 linux-s390x-ibm-race go@5e724ccb runtime.TestCrashDumpsAllThreads (log)
2023-12-08 00:29 linux-s390x-ibm-race go@788a2277 runtime.TestCrashDumpsAllThreads (log)
2023-12-08 00:50 linux-s390x-ibm-race go@4bf1ca4b runtime.TestCrashDumpsAllThreads (log)
2023-12-08 03:28 linux-s390x-ibm go@78b42a53 runtime.TestCrashDumpsAllThreads (log)
2023-12-09 21:47 linux-s390x-ibm-race go@ca804118 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-09 21:48 linux-s390x-ibm go@46ea4ab5 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-11 19:32 linux-s390x-ibm go@c844970f runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-11 21:37 linux-s390x-ibm go@c22781cb runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-11 20:30 linux-s390x-ibm-race go@78dcb532 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-12 19:42 linux-s390x-ibm-race go@c2079deb runtime.TestCrashDumpsAllThreads (log)
2023-12-12 22:10 linux-s390x-ibm-race go@dce7f335 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-12 16:13 linux-s390x-ibm go@e70d3433 runtime.TestCrashDumpsAllThreads (log)
2023-12-12 16:45 linux-s390x-ibm go@7baaa20e runtime.TestCrashDumpsAllThreads (log)
2023-12-12 17:12 linux-s390x-ibm go@ce43fb80 runtime.TestCrashDumpsAllThreads (log)
2023-12-12 18:40 linux-s390x-ibm go@699807f3 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-12 16:29 linux-s390x-ibm-race go@3f442ab0 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-13 00:22 linux-s390x-ibm-race go@400e24a8 runtime.TestCrashDumpsAllThreads (log)
2023-12-13 00:46 linux-s390x-ibm-race go@7cac742f runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-13 00:22 linux-s390x-ibm go@400e24a8 runtime.TestCrashDumpsAllThreads (log)
2023-12-13 00:46 linux-s390x-ibm go@7cac742f runtime.TestCrashDumpsAllThreads (log)
2023-12-13 14:32 linux-s390x-ibm go@58c28ba2 runtime.TestCrashDumpsAllThreads (log)
|
Since this seems to be very specific to the builder, in triage we're wondering if anyone from @golang/s390x could start taking a look. It seems to be failing often enough that bisection should identify the culprit, and then that might just reveal the issue. |
Found new dashboard test flakes for:
2023-12-13 20:40 linux-s390x-ibm go@d95e25e8 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-13 20:40 linux-s390x-ibm-race go@d95e25e8 runtime.TestCrashDumpsAllThreads (log)
|
@mknyszek @bcmills We had a look at this issue and we used git bisect to figure out the culprit commit. Bad Commit Id: de5b418b which introducing failure of TestCrashDumpsAllThreads() |
Found new dashboard test flakes for:
2023-12-15 22:00 linux-s390x-ibm go@9b4b3e5a runtime.TestCrashDumpsAllThreads (log)
2023-12-18 17:42 linux-s390x-ibm go@8e3930f2 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-18 23:29 linux-s390x-ibm-race go@7383b2a4 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-19 11:08 linux-s390x-ibm go@1d4b0b62 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-19 11:08 linux-s390x-ibm-race go@1d4b0b62 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2023-12-20 02:18 linux-s390x-ibm-race go@a2a2c5b9 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-03 18:49 linux-s390x-ibm go@61a3ee54 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-03 22:38 linux-s390x-ibm-race go@968e1ce1 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-04 22:54 linux-s390x-ibm go@99b65ae9 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-05 01:26 linux-s390x-ibm-race go@2e064cf1 runtime.TestCrashDumpsAllThreads (log)
2024-04-05 17:45 linux-s390x-ibm go@74cce866 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-08 21:43 linux-s390x-ibm go@d4395ebc runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-03 18:00 linux-s390x-ibm go@a65a2bbd runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-03-18 18:59 linux-s390x-ibm go@dc6a5cfc runtime.TestCrashDumpsAllThreads (log)
2024-04-17 21:09 linux-s390x-ibm-race go@4742c52e runtime.TestCrashDumpsAllThreads (log)
2024-04-18 16:00 linux-s390x-ibm-race go@a0205e65 runtime.TestCrashDumpsAllThreads (log)
2024-04-18 21:20 linux-s390x-ibm go@fa470f62 runtime.TestCrashDumpsAllThreads (log)
2024-04-18 22:17 linux-s390x-ibm-race go@01064622 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-23 01:21 linux-s390x-ibm-race go@9702cd98 runtime.TestCrashDumpsAllThreads (log)
2024-04-23 02:53 linux-s390x-ibm-race go@0304d035 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-25 00:43 linux-s390x-ibm-race go@799968df runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-25 01:02 linux-s390x-ibm-race go@4351af68 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-25 01:05 linux-s390x-ibm go@db5f2b41 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-26 00:39 linux-s390x-ibm go@5419f652 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-26 22:13 linux-s390x-ibm go@9effeeab runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-04-26 22:13 linux-s390x-ibm-race go@9effeeab runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-02 22:14 linux-s390x-ibm go@b64e5e38 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-06 17:39 linux-s390x-ibm-race go@9050ce9b runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-06 20:59 linux-s390x-ibm go@be29a021 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-08 16:13 linux-s390x-ibm-race go@328aa9e3 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-08 19:10 linux-s390x-ibm go@69e75c85 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-08 17:48 linux-s390x-ibm-race go@21413152 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-08 17:47 linux-s390x-ibm-race go@724bab15 runtime.TestCrashDumpsAllThreads (log)
2024-05-08 17:47 linux-s390x-ibm go@c3bd543c runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-08 17:09 linux-s390x-ibm go@93e3696b runtime.TestCrashDumpsAllThreads (log)
2024-05-08 17:44 linux-s390x-ibm-race go@11047345 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-08 16:12 linux-s390x-ibm-race go@5be95e09 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-09 16:18 linux-s390x-ibm-race go@483a913a runtime.TestCrashDumpsAllThreads (log)
2024-05-09 17:06 linux-s390x-ibm-race go@dd6dee48 runtime.TestCrashDumpsAllThreads (log)
|
Extending the total sleep time as in the CL https://go-review.googlesource.com/c/go/+/554615 seems to help avoid the TestCrashDumpsAllThreads failure on s390x, If we continue to get intermittent failures even after this is committed, probably there is a race condition angle in this case too as mentioned in #64752 (comment) |
Found new dashboard test flakes for:
2024-05-09 23:29 linux-s390x-ibm-race go@6584fe81 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-09 23:06 linux-s390x-ibm go@2064413b runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-09 22:42 linux-s390x-ibm go@f4bb7b91 runtime.TestCrashDumpsAllThreads (log)
|
Found new dashboard test flakes for:
2024-05-09 23:29 linux-s390x-ibm go@6584fe81 runtime.TestCrashDumpsAllThreads (log)
2024-05-10 02:36 linux-s390x-ibm go@1259a30a runtime.TestCrashDumpsAllThreads (log)
|
Go version
ca80411
What operating system and processor architecture are you using (
go env
)?What did you do?
https://build.golang.org/log/5e29be06bbb7a8a4923d83a58972aa2a10677a94
What did you expect to see?
All tests passing.
What did you see instead?
(attn @golang/s390x)
The text was updated successfully, but these errors were encountered: