x/build/cmd/coordinator: test “ran over” time limit output doesn't make it easy to tell where #53201

bcmills · 2022-06-02T14:30:07Z

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

From https://storage.googleapis.com/go-build-log/a1471cf8/openbsd-amd64-68_eba704c3.log (a TryBot on CL 400376):

openbsd-amd64-68 at a1471cf8dea8e0a6025e5ca649cc94871d436211

:: Running /tmp/workdir/go/src/make.bash with args ["/tmp/workdir/go/src/make.bash"] and env ["HOME=/" "PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/bin" "PWD=/" "INRC=1" "_=/bin/sh" "WORKDIR=/tmp/workdir" "GOROOT_BOOTSTRAP=/tmp/workdir/go1.4" "GO_BUILDER_NAME=openbsd-amd64-68" "GOBIN=" "TMPDIR=/tmp/workdir/tmp" "GOCACHE=/tmp/workdir/gocache"] in dir /tmp/workdir/go/src

…

Test "go_test:crypto/internal/subtle" ran over 20m0s limit (20m0.000698974s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 0.00GHz
# GOOS: openbsd
# OS Version: OpenBSD 6.8 OpenBSD 6.8 (GENERIC.MP) #2: Sat Dec  5 07:17:48 MST 2020     root@syspatch-68-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP  amd64

XXXBANNERXXX:Testing packages.
ok  	crypto/internal/subtle	0.017s
ok  	crypto/md5	0.023s
ok  	crypto/rand	0.054s


Error: tests failed: dist test failed: go_test:crypto/internal/subtle: Test "go_test:crypto/internal/subtle" ran over 20m0s limit (20m0.000698974s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 0.00GHz
# GOOS: openbsd
# OS Version: OpenBSD 6.8 OpenBSD 6.8 (GENERIC.MP) #2: Sat Dec  5 07:17:48 MST 2020     root@syspatch-68-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP  amd64

XXXBANNERXXX:Testing packages.
ok  	crypto/internal/subtle	0.017s
ok  	crypto/md5	0.023s
ok  	crypto/rand	0.054s

There are a few issues with this result:

The error message claims that go_test:crypto/internal/subtle ran over the time limit, but AFAICT it actually completed in 17ms. I'm not sure how to reconcile that.
The output from the test run is duplicated. (But duplicated is better than missing, at least! 😅)
The XXXBANNERXXX lines have not been stripped as expected.

Of those, I am most concerned with (1), so I'd like to focus this issue on that (but incidentally fixing the others would be nice too).

(attn @golang/release; I think this may be a latent issue uncovered by @dmitshur's recent timeout fix in CL 407555.)

The text was updated successfully, but these errors were encountered:

dmitshur · 2022-07-24T22:18:50Z

I looked into this a while back, and wanted to do more, but never got around to it. For now I'll just update this issue with a summary of what I found.

I think the timeout is accurate, but there's not enough information in the log to point out where. It likely wasn't crypto/internal/subtle but one of the packages after crypto/rand, i.e., crypto/rc4 or later. Our build error reporting can be improved to make investigating these types of findings easier.

bcmills · 2022-09-06T21:05:44Z

Another one here:
https://build.golang.org/log/5ac99059bf01a50e6d1773d2d987cc362992232b

ok  	cmd/go/internal/modfetch	0.023s
ok  	cmd/go/internal/modfetch/codehost	0.022s




Test "go_test:cmd/go/internal/modfetch/zip_sum_test" ran over 20m0s limit (20m0.000159002s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: openbsd
# OS Version: OpenBSD 6.8 OpenBSD 6.8 (GENERIC.MP) #2: Sat Dec  5 07:17:48 MST 2020     root@syspatch-68-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP  amd64

XXXBANNERXXX:Testing packages.
ok  	cmd/go/internal/modfetch/zip_sum_test	0.035s
ok  	cmd/go/internal/modindex	0.185s

bcmills · 2022-09-06T21:17:24Z

2022-08-23T18:13:38-72a76ca/openbsd-amd64-68:

ok  	cmd/compile/internal/importer	0.815s




Test "go_test:cmd/compile/internal/ir" ran over 20m0s limit (20m0.000456651s); saw output:

XXXBANNERXXX:Test execution environment.

[output truncated there]

bcmills · 2022-09-06T21:21:40Z

2022-08-24T22:39:01-ba5deb4/openbsd-arm64-jsing:

ok  	strings	14.971s




Test "go_test:sync" ran over 1h40m0s limit (1h40m0.000558962s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: arm64
# CPU: 
# GOOS: openbsd
# OS Version: OpenBSD 7.1 OpenBSD 7.1-stable (GENERIC.MP) #4: Fri Jun  3 17:30:51 AEST 2022     joel@gobuilder-arm64.sing.id.au:/usr/src/sys/arch/arm64/compile/GENERIC.MP  arm64

XXXBANNERXXX:Testing packages.
ok  	sync	2.545s
ok  	sync/atomic	12.330s

mknyszek · 2022-09-07T15:30:55Z

One more:

2022-09-02T20:14:16-646c3ee/openbsd-arm64-jsing

bcmills · 2022-09-14T14:12:40Z

2022-09-08T14:58:11-403f91c/openbsd-amd64-68:

ok  	debug/elf	0.051s




Test "go_test:debug/gosym" ran over 20m0s limit (20m0.000413252s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: openbsd
# OS Version: OpenBSD 6.8 OpenBSD 6.8 (GENERIC.MP) #2: Sat Dec  5 07:17:48 MST 2020     root@syspatch-68-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP  amd64

XXXBANNERXXX:Testing packages.
ok  	debug/gosym	0.084s

gopherbot · 2022-10-13T12:46:07Z

Found new dashboard test flakes for:

#!watchflakes
default <- test == "" && `^Test ".*" ran over .* limit`

2022-10-12 20:23 netbsd-386-9_0 go@69fc74f3 (log)

Test "go_test:internal/fmtsort" ran over 20m0s limit (20m0.000600276s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-12 20:23 netbsd-386-9_0 go@987f94fa (log)

Test "go_test:encoding/pem" ran over 20m0s limit (20m0.000138198s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-12 20:23 netbsd-386-9_0 go@e0d01b84 (log)

Test "go_test:cmd/pprof" ran over 20m0s limit (20m0.000115157s); saw output:

XXXBANNERXXX:Test execution environment.

— watchflakes

gopherbot · 2022-10-17T15:35:25Z

Found new dashboard test flakes for:

#!watchflakes
default <- test == "" && `^Test ".*" ran over .* limit`

2022-10-13 17:18 netbsd-386-9_0 go@f2acc607 (log)

Test "go_test:internal/coverage/slicereader" ran over 20m0s limit (20m0.000764035s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-13 18:47 netbsd-386-9_0 go@9fe17a03 (log)

Test "go_test:cmd/doc" ran over 20m0s limit (20m0.000761398s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-13 20:22 netbsd-386-9_0 go@005c78d8 (log)

Test "go_test:internal/fmtsort" ran over 20m0s limit (20m0.00088717s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-14 12:48 netbsd-386-9_0 go@e56c93f0 (log)

Test "go_test:internal/cpu" ran over 20m0s limit (20m0.000561047s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: 386
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/i386/compile/GENERIC  i386

XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2022-10-25T17:38:16Z

Found new dashboard test flakes for:

#!watchflakes
default <- test == "" && `^Test ".*" ran over .* limit`

2022-10-17 15:11 netbsd-386-9_0 go@1c783f7c (log)

Test "go_test:debug/plan9obj" ran over 20m0s limit (20m0.001114639s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: 386
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/i386/compile/GENERIC  i386

XXXBANNERXXX:Testing packages.

2022-10-17 15:15 netbsd-amd64-9_0 go@abd592b3 (log)

Test "go_test:image/gif" ran over 20m0s limit (20m0.001181272s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-17 15:15 netbsd-386-9_0 go@dacf88e4 (log)

Test "go_test:cmd/internal/obj/s390x" ran over 20m0s limit (20m0.000480453s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-17 18:22 windows-amd64-2012 go@3e100a22 (log)

Test "go_test:cmd/go" ran over 40m0s limit (40m0.001167172s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.20GHz
# GOOS: windows
# OS Version: 6.3.9600

XXXBANNERXXX:Testing packages.

2022-10-17 21:48 netbsd-386-9_0 go@26b48442 (log)

Test "moved_goroot" ran over 20m0s limit (20m0.00048075s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-18 20:58 netbsd-386-9_0 go@1f068f0d (log)

Test "go_test:crypto/md5" ran over 20m0s limit (20m0.001211735s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-20 21:52 netbsd-amd64-9_0 go@8415ec8c (log)

Test "sync_cpu" ran over 20m0s limit (20m0.000317066s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-20 23:11 netbsd-amd64-9_0 go@4c61e079 (log)

Test "go_test:container/heap" ran over 20m0s limit (20m0.000325819s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-21 05:28 netbsd-amd64-9_0 go@c75b10be (log)

Test "go_test:cmd/go/internal/test" ran over 20m0s limit (20m0.000371605s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-21 19:37 netbsd-386-9_0 go@99fcacfe (log)

Test "go_test:go/format" ran over 20m0s limit (20m0.000184706s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: 386
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/i386/compile/GENERIC  i386

XXXBANNERXXX:Testing packages.

2022-10-24 03:45 netbsd-386-9_0 go@2952fe4f (log)

Test "testgodefs" ran over 20m0s limit (20m0.000620302s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-24 21:18 netbsd-386-9_0 go@43192316 (log)

Test "go_test:net/http/cgi" ran over 20m0s limit (20m0.000335897s); saw output:

XXXBANNERXXX:Test execution environment.

— watchflakes

gopherbot · 2022-11-04T17:59:41Z

Found new dashboard test flakes for:

#!watchflakes
default <- test == "" && `^Test ".*" ran over .* limit`

2022-10-26 02:39 netbsd-386-9_0 go@069d1fc9 (log)

Test "go_test:cmd/internal/obj/ppc64" ran over 20m0s limit (20m0.001155145s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-26 14:08 netbsd-386-9_0 go@49abdbcc (log)

Test "go_test:context" ran over 20m0s limit (20m0.001060359s); saw output:

2022-10-27 01:24 netbsd-386-9_0 go@612bb34a (log)

Test "go_test:image" ran over 20m0s limit (20m0.000843669s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: 386
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/i386/compile/GENERIC  i386

XXXBANNERXXX:Testing packages.

2022-10-27 10:37 netbsd-386-9_0 go@50557edf (log)

Test "go_test:cmd/compile/internal/ssa" ran over 20m0s limit (20m0.000793638s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-27 17:38 netbsd-386-9_0 go@7f255ba0 (log)

Test "go_test:image/gif" ran over 20m0s limit (20m0.001279868s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-28 01:44 netbsd-386-9_0 go@537c4354 (log)

Test "cgo_errors" ran over 20m0s limit (20m0.000943765s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: 386
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/i386/compile/GENERIC  i386

XXXBANNERXXX:../misc/cgo/errors
PASS

ALL TESTS PASSED (some were excluded)

2022-10-28 17:33 netbsd-386-9_0 go@77296e36 (log)

Test "go_test:runtime/internal/math" ran over 20m0s limit (20m0.000290225s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-28 19:25 netbsd-amd64-9_0 go@42f334d6 (log)

Test "go_test:index/suffixarray" ran over 20m0s limit (20m0.0007932s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-28 23:50 netbsd-amd64-9_0 go@91a1f0d9 (log)

Test "go_test:cmd/go/internal/vcweb/vcstest" ran over 20m0s limit (20m0.000588343s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-31 19:20 netbsd-386-9_0 go@3aebf682 (log)

Test "go_test:cmd/compile/internal/abt" ran over 20m0s limit (20m0.000407813s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-31 20:16 netbsd-386-9_0 go@4b993bff (log)

Test "go_test:debug/buildinfo" ran over 20m0s limit (20m0.000276265s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: 386
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/i386/compile/GENERIC  i386

XXXBANNERXXX:Testing packages.

2022-10-31 20:16 netbsd-amd64-9_0 go@4b993bff (log)

Test "go_test:container/heap" ran over 20m0s limit (20m0.000423774s); saw output:

XXXBANNERXXX:Test execution environment.

2022-10-31 21:41 netbsd-386-9_0 go@7ddc4526 (log)

Test "go_test:go/ast" ran over 20m0s limit (20m0.001062285s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-02 14:38 netbsd-386-9_0 go@0aeda5af (log)

Test "go_test:os/user" ran over 20m0s limit (20m0.000357345s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-03 15:30 netbsd-386-9_0 go@e81263c7 (log)

Test "go_test:internal/singleflight" ran over 20m0s limit (20m0.000211409s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-03 15:33 netbsd-386-9_0 go@bb396569 (log)

Test "go_test:internal/profile" ran over 20m0s limit (20m0.000150212s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-03 15:33 netbsd-amd64-9_0 go@bb396569 (log)

Test "go_test:io" ran over 20m0s limit (20m0.000603304s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/amd64/compile/GENERIC  amd64

XXXBANNERXXX:Testing packages.

2022-11-03 18:33 netbsd-386-9_0 go@44cabb80 (log)

Test "go_test:go/ast" ran over 20m0s limit (20m0.000384683s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-03 20:32 netbsd-386-9_0 go@48ff5c10 (log)

Test "go_test:go/internal/gcimporter" ran over 20m0s limit (20m0.001021618s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-03 20:35 netbsd-386-9_0 go@aa6240a4 (log)

Test "go_test:sync/atomic" ran over 20m0s limit (20m0.000569659s); saw output:

XXXBANNERXXX:Test execution environment.

— watchflakes

gopherbot · 2022-11-17T16:07:03Z

Found new dashboard test flakes for:

#!watchflakes
default <- test == "" && `^Test ".*" ran over .* limit`

2022-11-08 03:06 netbsd-amd64-9_0 go@e6f662d7 (log)

Test "go_test:cmd/internal/goobj" ran over 20m0s limit (20m0.000176613s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-09 06:10 netbsd-386-9_0 go@268f4629 (log)

Test "osusergo" ran over 20m0s limit (20m0.000573568s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-09 06:30 netbsd-386-9_0 go@3a410941 (log)

Test "go_test:internal/fmtsort" ran over 20m0s limit (20m0.001026712s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: 386
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/i386/compile/GENERIC  i386

XXXBANNERXXX:Testing packages.

2022-11-09 14:47 netbsd-386-9_0 go@9ff2a667 (log)

Test "go_test:crypto/sha512" ran over 20m0s limit (20m0.000490185s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-11 01:42 netbsd-386-9_0 go@d62f8d5f (log)

Test "go_test:cmd/go/internal/work" ran over 20m0s limit (20m0.000338196s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-11 21:32 netbsd-amd64-9_0 go@c6539796 (log)

Test "go_test:cmd/go" ran over 20m0s limit (20m0.00031782s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-11 21:43 netbsd-386-9_0 go@7e4191e6 (log)

PASS




Test "bench_go1" ran over 20m0s limit (20m0.000416305s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-11 23:24 netbsd-amd64-9_0 go@122a22e0 (log)

Test "go_test:internal/profile" ran over 20m0s limit (20m0.000945751s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/amd64/compile/GENERIC  amd64

XXXBANNERXXX:Testing packages.

2022-11-14 05:30 netbsd-386-9_0 go@c55d1841 (log)

Test "go_test:strconv" ran over 20m0s limit (20m0.000989426s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-14 14:32 netbsd-amd64-9_0 go@40bdcbb4 (log)

Test "go_test:cmd/go/internal/imports" ran over 20m0s limit (20m0.000228552s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-14 15:19 netbsd-amd64-9_0 go@ea4631cc (log)

Test "go_test:encoding/pem" ran over 20m0s limit (20m0.000427893s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/amd64/compile/GENERIC  amd64

XXXBANNERXXX:Testing packages.

2022-11-14 19:43 netbsd-amd64-9_0 go@f02bc56d (log)

Test "go_test:image" ran over 20m0s limit (20m0.000704858s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-14 20:43 netbsd-386-9_0 go@da564d00 (log)

Test "go_test:cmd/internal/obj" ran over 20m0s limit (20m0.000695631s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-15 20:28 netbsd-386-9_0 go@d03e442e (log)

Test "go_test:cmd/compile/internal/reflectdata" ran over 20m0s limit (20m0.00093275s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-16 21:21 netbsd-386-9_0 go@ad7dc8ad (log)

Test "go_test:cmd/link/internal/benchmark" ran over 20m0s limit (20m0.000083174s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-16 21:35 netbsd-386-9_0 go@898d000c (log)

PASS




Test "cgo:test-auto" ran over 20m0s limit (20m0.000530271s); saw output:

XXXBANNERXXX:Test execution environment.

2022-11-16 21:35 netbsd-amd64-9_0 go@4d1052b0 (log)

Test "go_test:internal/singleflight" ran over 20m0s limit (20m0.000850681s); saw output:

2022-11-17 03:47 netbsd-amd64-9_0 go@fee0ab8b (log)

Test "go_test:cmd/internal/obj/s390x" ran over 20m0s limit (20m0.000638653s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: netbsd
# OS Version: NetBSD 9.0 NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020  mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/amd64/compile/GENERIC  amd64

XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2022-11-21T17:14:20Z

Found new dashboard test flakes for:

#!watchflakes
default <- test == "" && `^Test ".*" ran over .* limit`

2022-11-17 15:49 netbsd-amd64-9_0 go@42d975e5 (log)

Test "go_test:cmd/api" ran over 20m0s limit (20m0.000816887s); saw output:

2022-11-17 16:06 netbsd-386-9_0 go@1daa8e2d (log)

Test "go_test:go/internal/gcimporter" ran over 20m0s limit (20m0.000149811s); saw output:

2022-11-17 17:02 netbsd-386-9_0 go@cafb49ac (log)

Test "cgo:test-internal" ran over 20m0s limit (20m0.000572054s); saw output:


XXXBANNERXXX:../misc/cgo/test

2022-11-17 17:38 netbsd-386-9_0 go@38b9ff60 (log)

Test "go_test:context" ran over 20m0s limit (20m0.000508722s); saw output:

2022-11-17 20:52 netbsd-386-9_0 go@6e0e492e (log)

Test "go_test:image" ran over 20m0s limit (20m0.00013691s); saw output:

2022-11-19 16:48 netbsd-386-9_0 go@5aa6313e (log)

Test "cgo:testtls-static" ran over 20m0s limit (20m0.000686415s); saw output:

— watchflakes

bcmills · 2022-11-21T17:31:11Z

Updated #55166 to exclude netbsd-.*-9_0 now that the 9_3 builders are up and running. However, the cmd/coordinator bug still ought to be fixed at some point too.

gopherbot · 2022-11-28T18:10:58Z

Found new dashboard test flakes for:

#!watchflakes
default <- test == "" && `^Test ".*" ran over .* limit`

2022-11-23 19:37 netbsd-arm64-bsiegert go@109de31a (log)

Test "go_test:cmd/go/internal/web" ran over 3h20m0s limit (3h20m0.000204343s); saw output:

— watchflakes

gopherbot · 2022-12-27T15:23:13Z

Found new dashboard test flakes for:

#!watchflakes
default <- test == "" && `^Test ".*" ran over .* limit`

2022-12-22 04:34 netbsd-arm-bsiegert go@de6abd78 (log)

Test "go_test:cmd/internal/obj/ppc64" ran over 3h20m0s limit (3h20m0.001229987s); saw output:

— watchflakes

gopherbot · 2023-01-16T21:45:44Z

Found new dashboard test flakes for:

#!watchflakes
default <- test == "" && `^Test ".*" ran over .* limit`

2023-01-11 17:10 netbsd-arm-bsiegert go@6ad27161 (log)

Test "go_test:image/draw" ran over 3h20m0s limit (3h20m0.000542161s); saw output:

— watchflakes

gopherbot · 2023-01-25T16:37:15Z

Found new dashboard test flakes for:

#!watchflakes
default <- test == "" && `^Test ".*" ran over .* limit`

2023-01-17 19:55 freebsd-amd64-race go@4210ebcd (log)

Test "go_test_bench:runtime" ran over 20m0s limit (20m0.00073455s); saw output:


XXXBANNERXXX:Running benchmarks briefly.
goos: freebsd
goarch: amd64
pkg: runtime
cpu: Intel(R) Xeon(R) CPU @ 2.20GHz
BenchmarkMakeChan/Byte-4                  	 1102220	       113.3 ns/op
BenchmarkMakeChan/Int-4                   	  908047	       142.0 ns/op
...
BenchmarkConvT2Ezero/smallint/32-4        	 5633344	        21.29 ns/op
BenchmarkConvT2Ezero/smallint/64-4        	 5623501	        21.58 ns/op
BenchmarkConvT2Ezero/largeint/16-4        	 1719093	        70.53 ns/op
BenchmarkConvT2Ezero/largeint/32-4        	 1717174	        67.16 ns/op
BenchmarkConvT2Ezero/largeint/64-4        	 1834216	        70.54 ns/op
BenchmarkMalloc8-4                        	 1481701	        79.09 ns/op
BenchmarkMalloc16-4                       	 1458068	        80.37 ns/op
BenchmarkMallocTypeInfo8-4                	 1543048	        77.91 ns/op
BenchmarkMallocTypeInfo16-4               	 1227980	        97.58 ns/op
BenchmarkMallocLargeStruct-4              	  188370	       742.5 ns/op

— watchflakes

gopherbot · 2023-09-08T17:11:55Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-08-29 20:28 linux-s390x-ibm-race go@08bf6d14 (log)

Test {"go_test_bench:runtime" "runtime:racebench"} ran over 40m0s limit (40m0.001036861s); saw output:


XXXBANNERXXX:Running benchmarks briefly.
goos: linux
goarch: s390x
pkg: runtime
BenchmarkCallers/cached-4                     	   10000	     10548 ns/op
BenchmarkCallers/inlined-4                    	   85327	      1913 ns/op
BenchmarkCallers/no-cache-4                   	   28174	      4666 ns/op
...
BenchmarkFastrandn/5-4                                          	 5864268	        49.41 ns/op
BenchmarkIfaceCmp100-4                                          	   61794	      5180 ns/op
BenchmarkIfaceCmpNil100-4                                       	  157186	      1689 ns/op
BenchmarkEfaceCmpDiff-4                                         	   15556	     23141 ns/op
BenchmarkEfaceCmpDiffIndirect-4                                 	   10000	     12593 ns/op
BenchmarkDefer-4                                                	 1442608	       558.7 ns/op
BenchmarkDefer10-4                                              	  997434	      2298 ns/op
BenchmarkDeferMany-4                                            	  231063	      2199 ns/op
BenchmarkPanicRecover-4                                         	  874032	       980.4 ns/op
BenchmarkGoroutineProfile/small-nil/idle-4                      	     170	   1166643 ns/op	     58626 p50-ns	   3801884 p90-ns	  10283920 p99-ns

2023-09-04 17:50 android-amd64-emu go@c56f4634 (log)

Test {"go_test:archive/tar" "archive/tar"} ran over 20m0s limit (20m0.000704657s); saw output:


tests failed: dist test failed: {go_test:archive/tar archive/tar}: Test {"go_test:archive/tar" "archive/tar"} ran over 20m0s limit (20m0.000704657s); saw output:

— watchflakes

gopherbot · 2023-09-27T15:14:34Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-09-27 14:22 openbsd-amd64-72 go@48042aa0 (log)

Test {"go_test:compress/flate" "compress/flate"} ran over 20m0s limit (20m0.000516159s); saw output:

— watchflakes

gopherbot · 2023-10-25T15:04:41Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-10-18 01:29 ios-arm64-corellium go@fb726698 (log)

2023-10-23 09:06 ios-arm64-corellium go@bc2124da (log)

2023-10-23 17:31 ios-arm64-corellium go@255ed03a (log)

2023-10-23 18:44 ios-arm64-corellium go@c65f74d3 (log)

— watchflakes

gopherbot · 2023-11-02T20:03:29Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-02 19:15 netbsd-386-9_3 go@2ffe600d (log)

ALL TESTS PASSED (some were excluded)

— watchflakes

gopherbot · 2023-11-06T22:12:21Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-06 21:18 netbsd-386-9_3 go@f83bbaf3 (log)

ALL TESTS PASSED (some were excluded)

— watchflakes

gopherbot · 2023-11-08T16:58:43Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-08 15:32 netbsd-amd64-9_3 go@45320c23 (log)

ALL TESTS PASSED (some were excluded)

— watchflakes

gopherbot · 2023-11-10T00:22:34Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-09 22:38 linux-ppc64le-power9osu go@130baf3d (log)

Test {"go_test:cmd/compile/internal/ssa" "cmd/compile/internal/ssa"} ran over 40m0s limit (40m0.000652065s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2023-11-10T16:35:43Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-10 02:22 linux-ppc64le-buildlet go@1fc45e9a (log)

Test {"go_test:cmd/compile/internal/amd64" "cmd/compile/internal/amd64"} ran over 40m0s limit (40m0.000496909s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2023-11-10T17:58:47Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-10 15:49 linux-ppc64le-power9osu go@43ffe2a8 (log)

— watchflakes

gopherbot · 2023-11-10T21:26:03Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-10 18:45 linux-ppc64le-power9osu go@505dff4f (log)

— watchflakes

gopherbot · 2023-11-10T22:07:30Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-10 20:43 linux-ppc64le-power10osu go@4346ba34 (log)

— watchflakes

gopherbot · 2023-11-16T18:06:19Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-16 05:53 netbsd-amd64-9_3 go@d6ef98b8 (log)

Test {"go_test:cmd/compile/internal/ssa" "cmd/compile/internal/ssa"} ran over 20m0s limit (20m0.001221313s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2023-11-23T00:25:02Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-22 04:41 ios-arm64-corellium go@5abae02d (log)

Test {"go_test:cmd/go" "cmd/go"} ran over 20m0s limit (20m0.000804594s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2023-11-25T16:33:01Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-21 23:27 ios-arm64-corellium go@059a9eed (log)

Test {"go_test:cmd/go" "cmd/go"} ran over 20m0s limit (20m0.000769166s); saw output:


XXXBANNERXXX:Testing packages.

2023-11-21 23:27 ios-arm64-corellium go@dc5a0d27 (log)

Test {"go_test:cmd/go" "cmd/go"} ran over 20m0s limit (20m0.001146864s); saw output:


XXXBANNERXXX:Testing packages.

2023-11-22 01:50 ios-arm64-corellium go@9840d38c (log)

Test {"go_test:cmd/go" "cmd/go"} ran over 20m0s limit (20m0.000301085s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2023-11-28T18:46:18Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-28 05:13 netbsd-arm-bsiegert go@46410b78 (log)

Test {"go_test:go/scanner" "go/scanner"} ran over 3h20m0s limit (3h20m0.000967678s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2023-12-05T15:46:30Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-29 19:13 ios-arm64-corellium go@636c6e35 (log)

Test {"go_test:cmd/go" "cmd/go"} ran over 20m0s limit (20m0.000689066s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2023-12-08T20:40:29Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-12-04 19:27 ios-arm64-corellium go@818de275 (log)

Test {"go_test:cmd/go" "cmd/go"} ran over 20m0s limit (20m0.000534529s); saw output:


XXXBANNERXXX:Testing packages.

2023-12-04 23:03 ios-arm64-corellium go@098f059d (log)

Test {"go_test:cmd/go" "cmd/go"} ran over 20m0s limit (20m0.000529996s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2023-12-19T08:41:53Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-12-05 20:45 ios-arm64-corellium go@5686b650 (log)

— watchflakes

gopherbot · 2023-12-20T01:46:37Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-12-19 11:08 ios-arm64-corellium go@1d4b0b62 (log)

— watchflakes

gopherbot · 2023-12-20T02:49:24Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-12-19 15:51 ios-arm64-corellium go@9dd1cde9 (log)

— watchflakes

gopherbot · 2023-12-20T16:24:40Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-12-04 18:17 ios-arm64-corellium go@92b6cdeb (log)

Test {"go_test:cmd/go" "cmd/go"} ran over 20m0s limit (20m0.00056302s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2023-12-22T05:40:33Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-11-21 21:30 ios-arm64-corellium go@41f58b22 (log)

Test {"go_test:cmd/go" "cmd/go"} ran over 20m0s limit (20m0.000398269s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2024-01-20T02:33:29Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2024-01-19 22:19 ios-arm64-corellium go@f5e475ed (log)

— watchflakes

gopherbot · 2024-01-25T17:39:10Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2024-01-10 20:16 netbsd-amd64-9_3 go@2540b143 (log)

ALL TESTS PASSED (some were excluded)

— watchflakes

gopherbot · 2024-02-06T22:50:15Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2023-12-19 14:29 openbsd-amd64-72 go@f06eaf0c (log)

Test {"go_test:cmd/cgo/internal/testcarchive" "cmd/cgo/internal/testcarchive"} ran over 20m0s limit (20m0.001199944s); saw output:

— watchflakes

gopherbot · 2024-02-14T06:55:15Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2024-02-13 20:50 netbsd-amd64-9_3 go@0286a082 (log)

Test {"cmd/cgo/internal/test:external-g0" "cmd/cgo/internal/test:external-g0"} ran over 20m0s limit (20m0.000372801s); saw output:


XXXBANNERXXX:Testing cgo

— watchflakes

gopherbot · 2024-02-28T20:13:35Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2024-02-28 19:10 android-386-emu go@5330cd22 (log)

Test {"go_test:archive/tar" "archive/tar"} ran over 20m0s limit (20m0.000794569s); saw output:


tests failed: dist test failed: {go_test:archive/tar archive/tar}: Test {"go_test:archive/tar" "archive/tar"} ran over 20m0s limit (20m0.000794569s); saw output:

— watchflakes

gopherbot · 2024-03-06T19:42:24Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2024-03-06 16:24 netbsd-amd64-9_3 go@f0d1195e (log)

Test {"runtime:cpu4" "runtime:cpu4"} ran over 20m0s limit (20m0.000599497s); saw output:

— watchflakes

gopherbot · 2024-04-11T21:19:20Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2024-04-09 17:45 netbsd-arm-bsiegert go@ecfddf48 (log)

Test {"go_test:testing" "testing"} ran over 3h20m0s limit (3h20m0.000577482s); saw output:


XXXBANNERXXX:Testing packages.

— watchflakes

gopherbot · 2024-04-26T01:55:56Z

Found new dashboard test flakes for:

#!watchflakes
default <- log ~ `^Test .* ran over .* limit`

2024-04-25 20:23 netbsd-amd64-9_3 go@1ca31eac (log)

— watchflakes

gopherbot added the Builders x/build issues (builders, bots, dashboards) label Jun 2, 2022

gopherbot added this to the Unreleased milestone Jun 2, 2022

dmitshur added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Jun 2, 2022

dmitshur self-assigned this Jun 7, 2022

dmitshur removed their assignment Jul 24, 2022

dmitshur changed the title ~~x/build/cmd/coordinator: test “ran over” time limit, but output claims that it finished~~ x/build/cmd/coordinator: test “ran over” time limit output doesn't make it easy to tell where Jul 24, 2022

bcmills mentioned this issue Sep 6, 2022

build dashboard triage log #52653

Closed

This was referenced Sep 21, 2022

build: unrecognized failures on openbsd-amd64-68 #55319

Closed

build: unrecognized failures on linux-ppc64-buildlet #55314

Open

build: unrecognized failures on openbsd-arm64-jsing #55310

Open

bcmills mentioned this issue Jan 23, 2023

runtime: tests failing to terminate on ios-arm64-corellium #57962

Closed

bcmills mentioned this issue Jan 25, 2023

Testing packages.: unrecognized failures #57995

Closed

x/build/cmd/coordinator: test “ran over” time limit output doesn't make it easy to tell where #53201

x/build/cmd/coordinator: test “ran over” time limit output doesn't make it easy to tell where #53201

Comments

bcmills commented Jun 2, 2022 • edited Loading

dmitshur commented Jul 24, 2022

bcmills commented Sep 6, 2022

bcmills commented Sep 6, 2022

bcmills commented Sep 6, 2022

mknyszek commented Sep 7, 2022

bcmills commented Sep 14, 2022

gopherbot commented Oct 13, 2022

gopherbot commented Oct 17, 2022

gopherbot commented Oct 25, 2022

gopherbot commented Nov 4, 2022

gopherbot commented Nov 17, 2022

gopherbot commented Nov 21, 2022

bcmills commented Nov 21, 2022

gopherbot commented Nov 28, 2022

gopherbot commented Dec 27, 2022

gopherbot commented Jan 16, 2023

gopherbot commented Jan 25, 2023

gopherbot commented Sep 8, 2023

gopherbot commented Sep 27, 2023

gopherbot commented Oct 25, 2023

gopherbot commented Nov 2, 2023

gopherbot commented Nov 6, 2023

gopherbot commented Nov 8, 2023

gopherbot commented Nov 10, 2023

gopherbot commented Nov 10, 2023

gopherbot commented Nov 10, 2023

gopherbot commented Nov 10, 2023

gopherbot commented Nov 10, 2023

gopherbot commented Nov 16, 2023

gopherbot commented Nov 23, 2023

gopherbot commented Nov 25, 2023

gopherbot commented Nov 28, 2023

gopherbot commented Dec 5, 2023

gopherbot commented Dec 8, 2023

gopherbot commented Dec 19, 2023

gopherbot commented Dec 20, 2023

gopherbot commented Dec 20, 2023

gopherbot commented Dec 20, 2023

gopherbot commented Dec 22, 2023

gopherbot commented Jan 20, 2024

gopherbot commented Jan 25, 2024

gopherbot commented Feb 6, 2024

gopherbot commented Feb 14, 2024

gopherbot commented Feb 28, 2024

gopherbot commented Mar 6, 2024

gopherbot commented Apr 11, 2024

gopherbot commented Apr 26, 2024

bcmills commented Jun 2, 2022 •

edited

Loading