Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build: build failure on linux-amd64_[…]-perf_vs_release due to "failed to execute benchmarks: gvisor" #68437

Closed
gopherbot opened this issue Jul 15, 2024 · 27 comments
Labels
NeedsFix The path to resolution is known, but the work has not been done.
Milestone

Comments

@gopherbot
Copy link
Contributor

gopherbot commented Jul 15, 2024

#!watchflakes
default <- builder ~ `linux-amd64_.+-perf_vs_release$` && repo == "go" && mode == "build" && `error: failed to execute benchmarks: gvisor`

Issue created automatically to collect these failures.

Example (log):

go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/06/17 17:38:13 Load average: 12.08 4.51 1.64 1/399 27106
2024/06/17 17:38:13 Waiting for load average to drop below 0.20...
2024/06/17 17:38:43 Load average: 7.40 4.09 1.59 1/399 27106
2024/06/17 17:38:43 Waiting for load average to drop below 0.20...
2024/06/17 17:39:13 Load average: 4.48 3.70 1.54 1/399 27106
2024/06/17 17:39:13 Waiting for load average to drop below 0.20...
2024/06/17 17:39:43 Load average: 2.72 3.35 1.49 1/399 27106
2024/06/17 17:39:43 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/06/17 23:52:23 Error running sweet: error running sweet run: exit status 1
2024/06/17 23:52:23 FAIL
exit status 1

watchflakes

@gopherbot gopherbot added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Jul 15, 2024
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2024-06-17 17:35 gotip-linux-amd64_c2s16-perf_vs_release go@22cf1e7f [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/06/17 17:38:13 Load average: 12.08 4.51 1.64 1/399 27106
2024/06/17 17:38:13 Waiting for load average to drop below 0.20...
2024/06/17 17:38:43 Load average: 7.40 4.09 1.59 1/399 27106
2024/06/17 17:38:43 Waiting for load average to drop below 0.20...
2024/06/17 17:39:13 Load average: 4.48 3.70 1.54 1/399 27106
2024/06/17 17:39:13 Waiting for load average to drop below 0.20...
2024/06/17 17:39:43 Load average: 2.72 3.35 1.49 1/399 27106
2024/06/17 17:39:43 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/06/17 23:52:23 Error running sweet: error running sweet run: exit status 1
2024/06/17 23:52:23 FAIL
exit status 1
2024-06-18 01:14 gotip-linux-amd64_c2s16-perf_vs_release go@3e10c1ff [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/06/18 01:17:59 Load average: 10.16 3.75 1.36 1/400 817767
2024/06/18 01:17:59 Waiting for load average to drop below 0.20...
2024/06/18 01:18:29 Load average: 6.16 3.39 1.32 1/400 817767
2024/06/18 01:18:29 Waiting for load average to drop below 0.20...
2024/06/18 01:18:59 Load average: 3.78 3.08 1.28 1/400 817767
2024/06/18 01:18:59 Waiting for load average to drop below 0.20...
2024/06/18 01:19:29 Load average: 2.29 2.78 1.24 1/400 817767
2024/06/18 01:19:29 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/06/18 05:46:35 Error running sweet: error running sweet run: exit status 1
2024/06/18 05:46:35 FAIL
exit status 1
2024-06-18 15:33 gotip-linux-amd64_c2s16-perf_vs_release go@e44fa1c1 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/06/18 15:35:45 Load average: 13.15 4.65 1.67 1/391 29038
2024/06/18 15:35:45 Waiting for load average to drop below 0.20...
2024/06/18 15:36:15 Load average: 8.03 4.22 1.62 1/391 29038
2024/06/18 15:36:15 Waiting for load average to drop below 0.20...
2024/06/18 15:36:45 Load average: 4.86 3.82 1.57 1/391 29038
2024/06/18 15:36:45 Waiting for load average to drop below 0.20...
2024/06/18 15:37:15 Load average: 2.95 3.45 1.52 1/391 29038
2024/06/18 15:37:15 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/06/18 21:10:10 Error running sweet: error running sweet run: exit status 1
2024/06/18 21:10:10 FAIL
exit status 1
2024-06-18 18:48 gotip-linux-amd64_c2s16-perf_vs_release go@cef0a2ec [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/06/19 04:26:30 Load average: 0.17 0.04 0.01 1/374 41148
2024/06/19 04:26:30 Running Go test benchmarks for experiment
go: downloading github.com/biogo/biogo v1.0.4
go: downloading go.etcd.io/etcd/client/v3 v3.5.8
go: downloading github.com/yuin/gopher-lua v0.0.0-20210529063254-f4c35e4016d9
go: downloading github.com/blevesearch/bleve v1.0.14
go: downloading github.com/dustin/go-wikiparse v0.0.0-20211018054215-c01ec186f20c
go: downloading github.com/google/pprof v0.0.0-20211122183932-1daafda22083
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/06/19 10:42:06 Error running sweet: error running sweet run: exit status 1
2024/06/19 10:42:06 FAIL
exit status 1
2024-06-18 19:07 gotip-linux-amd64_c2s16-perf_vs_release go@2b12bbcb [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/06/18 23:49:32 Load average: 0.15 0.03 0.01 1/374 2514
2024/06/18 23:49:32 Running Go test benchmarks for experiment
go: downloading github.com/google/pprof v0.0.0-20211122183932-1daafda22083
go: downloading github.com/biogo/biogo v1.0.4
go: downloading github.com/yuin/gopher-lua v0.0.0-20210529063254-f4c35e4016d9
go: downloading github.com/blevesearch/bleve v1.0.14
go: downloading github.com/dustin/go-wikiparse v0.0.0-20211018054215-c01ec186f20c
go: downloading go.etcd.io/etcd/client/v3 v3.5.8
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/06/19 04:35:17 Error running sweet: error running sweet run: exit status 1
2024/06/19 04:35:17 FAIL
exit status 1
2024-06-18 22:25 gotip-linux-amd64_c2s16-perf_vs_release go@4f77a835 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/06/18 22:47:47 Load average: 3.80 6.57 7.50 1/393 1758328
2024/06/18 22:47:47 Waiting for load average to drop below 0.20...
2024/06/18 22:48:17 Load average: 2.45 5.98 7.27 1/393 1758328
2024/06/18 22:48:17 Waiting for load average to drop below 0.20...
2024/06/18 22:48:47 Load average: 1.54 5.42 7.04 1/393 1758328
2024/06/18 22:48:47 Waiting for load average to drop below 0.20...
2024/06/18 22:49:17 Load average: 0.93 4.90 6.82 1/393 1758328
2024/06/18 22:49:17 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/06/19 05:12:10 Error running sweet: error running sweet run: exit status 1
2024/06/19 05:12:10 FAIL
exit status 1
2024-06-20 16:46 gotip-linux-amd64_c2s16-perf_vs_release go@477ad7dd [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/06/20 16:50:38 Load average: 9.80 3.62 1.67 1/386 791313
2024/06/20 16:50:38 Waiting for load average to drop below 0.20...
2024/06/20 16:51:08 Load average: 6.09 3.30 1.63 1/386 791313
2024/06/20 16:51:08 Waiting for load average to drop below 0.20...
2024/06/20 16:51:38 Load average: 3.69 2.99 1.58 1/386 791313
2024/06/20 16:51:38 Waiting for load average to drop below 0.20...
2024/06/20 16:52:08 Load average: 2.23 2.70 1.52 1/386 791313
2024/06/20 16:52:08 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/06/20 21:25:48 Error running sweet: error running sweet run: exit status 1
2024/06/20 21:25:48 FAIL
exit status 1
2024-06-23 00:52 gotip-linux-amd64_c2s16-perf_vs_release go@e8ee1dc4 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/06/23 00:55:18 Load average: 9.77 3.49 1.26 1/388 23448
2024/06/23 00:55:18 Waiting for load average to drop below 0.20...
2024/06/23 00:55:48 Load average: 5.92 3.15 1.22 1/388 23448
2024/06/23 00:55:48 Waiting for load average to drop below 0.20...
2024/06/23 00:56:18 Load average: 3.59 2.85 1.17 1/388 23448
2024/06/23 00:56:18 Waiting for load average to drop below 0.20...
2024/06/23 00:56:48 Load average: 2.17 2.58 1.14 1/388 23448
2024/06/23 00:56:48 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/06/23 08:12:47 Error running sweet: error running sweet run: exit status 1
2024/06/23 08:12:47 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2024-07-16 16:43 gotip-linux-amd64_c2s16-perf_vs_release go@8b482908 [build] (log)
2024/07/16 16:44:28 run starting
[I2024-07-16T16:44:28.524966Z 398 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-16T16:44:28.525610Z 398 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-16T16:44:28.526839Z 398 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-16T16:44:28.526914Z 398 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-16T16:44:28.527054Z 398 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-16T16:44:28.527259Z 398 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-16T16:44:28.527629Z 398 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-16T16:44:30.477796Z 398 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
2024/07/16 16:44:30 installed tools
...
Top-level logs:
* [benchmark results](https://logs.chromium.org/logs/golang/buildbucket/cr-buildbucket/8742238963553227441/+/u/log/0)

Error:

	error committing perfdata file: upload failed: 500 Internal Server Error
	Error 1205: Lock wait timeout exceeded; try restarting transaction
	

Additional links for debugging:

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2024-07-25 14:38 gotip-linux-amd64_c2s16-perf_vs_release go@e76353d5 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/07/25 14:52:24 Load average: 1.71 5.56 7.22 1/390 3379213
2024/07/25 14:52:24 Waiting for load average to drop below 0.20...
2024/07/25 14:52:54 Load average: 1.18 5.06 7.00 1/391 3379213
2024/07/25 14:52:54 Waiting for load average to drop below 0.20...
2024/07/25 14:53:24 Load average: 0.71 4.58 6.78 1/391 3379213
2024/07/25 14:53:24 Waiting for load average to drop below 0.20...
2024/07/25 14:53:54 Load average: 0.43 4.14 6.56 1/391 3379213
2024/07/25 14:53:54 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/07/25 22:02:02 Error running sweet: error running sweet run: exit status 1
2024/07/25 22:02:02 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2024-07-23 19:05 gotip-linux-amd64_c2s16-perf_vs_release go@fc5073bc [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/07/23 20:18:58 Load average: 0.60 0.83 3.81 1/372 1363
2024/07/23 20:18:58 Waiting for load average to drop below 0.20...
2024/07/23 20:19:28 Load average: 0.36 0.75 3.69 1/372 1363
2024/07/23 20:19:28 Waiting for load average to drop below 0.20...
2024/07/23 20:19:58 Load average: 0.22 0.67 3.57 1/372 1363
2024/07/23 20:19:58 Waiting for load average to drop below 0.20...
2024/07/23 20:20:28 Load average: 0.13 0.61 3.46 1/372 1363
2024/07/23 20:20:28 Running Go test benchmarks for experiment
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/07/24 00:08:04 Error running sweet: error running sweet run: exit status 1
2024/07/24 00:08:04 FAIL
exit status 1
2024-07-23 19:17 gotip-linux-amd64_c2s16-perf_vs_release go@d567ea65 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/07/23 20:07:35 Load average: 1.35 0.28 0.09 1/390 2385
2024/07/23 20:07:35 Waiting for load average to drop below 0.20...
2024/07/23 20:08:05 Load average: 1.05 0.30 0.10 1/391 2386
2024/07/23 20:08:05 Waiting for load average to drop below 0.20...
2024/07/23 20:08:35 Load average: 0.75 0.31 0.11 1/391 2386
2024/07/23 20:08:35 Waiting for load average to drop below 0.20...
2024/07/23 20:09:05 Load average: 0.45 0.27 0.10 1/391 2386
2024/07/23 20:09:05 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/07/23 23:58:16 Error running sweet: error running sweet run: exit status 1
2024/07/23 23:58:16 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2024-07-27 08:44 gotip-linux-amd64_c2s16-perf_vs_release go@0a9321ad [build] (log)
2024/07/27 08:58:09 run starting
[I2024-07-27T08:58:09.614935Z 290 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-27T08:58:09.616330Z 290 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-27T08:58:09.616761Z 290 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-27T08:58:09.616821Z 290 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-27T08:58:09.616902Z 290 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-27T08:58:09.617223Z 290 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-07-27T08:58:09.617400Z 290 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
2024/07/27 08:58:11 installed tools
[I2024-07-27T08:58:11.684816Z 290 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
...
Top-level logs:
* [benchmark results](https://logs.chromium.org/logs/golang/buildbucket/cr-buildbucket/8741271730172013697/+/u/log/0)

Error:

	error committing perfdata file: upload failed: 500 Internal Server Error
	Error 1213: Deadlock found when trying to get lock; try restarting transaction
	

Additional links for debugging:

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2024-08-14 18:04 gotip-linux-amd64_c2s16-perf_vs_release go@32da8f51 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/08/14 18:06:52 Load average: 9.83 3.74 1.36 1/388 23023
2024/08/14 18:06:52 Waiting for load average to drop below 0.20...
2024/08/14 18:07:22 Load average: 5.96 3.38 1.32 1/388 23023
2024/08/14 18:07:22 Waiting for load average to drop below 0.20...
2024/08/14 18:07:52 Load average: 3.61 3.06 1.27 1/388 23023
2024/08/14 18:07:52 Waiting for load average to drop below 0.20...
2024/08/14 18:08:22 Load average: 2.19 2.76 1.23 1/388 23023
2024/08/14 18:08:22 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/08/15 00:35:58 Error running sweet: error running sweet run: exit status 1
2024/08/15 00:35:58 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2024-09-04 20:44 gotip-linux-amd64_c2s16-perf_vs_release go@9ba8ac25 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/09/04 21:04:43 Load average: 0.13 0.03 0.01 1/390 1501
2024/09/04 21:04:43 Running Go test benchmarks for experiment
go: downloading go.etcd.io/etcd/client/v3 v3.5.8
go: downloading github.com/blevesearch/bleve v1.0.14
go: downloading github.com/yuin/gopher-lua v0.0.0-20210529063254-f4c35e4016d9
go: downloading github.com/dustin/go-wikiparse v0.0.0-20211018054215-c01ec186f20c
go: downloading github.com/biogo/biogo v1.0.4
go: downloading gitlab.com/golang-commonmark/markdown v0.0.0-20211110145824-bf3e522c626a
...
[sweet] Running benchmark tile38 for experiment: run 7
[sweet] Running benchmark tile38 for baseline: run 7
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
2024/09/05 04:16:33 FAIL
exit status 1
2024-09-04 20:44 gotip-linux-amd64_c2s16-perf_vs_release go@a2891aef [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/09/04 20:57:50 Load average: 3.79 7.07 7.95 1/387 1735812
2024/09/04 20:57:50 Waiting for load average to drop below 0.20...
2024/09/04 20:58:20 Load average: 2.45 6.43 7.71 1/388 1735812
2024/09/04 20:58:20 Waiting for load average to drop below 0.20...
2024/09/04 20:58:50 Load average: 1.48 5.81 7.46 1/388 1735812
2024/09/04 20:58:50 Waiting for load average to drop below 0.20...
2024/09/04 20:59:20 Load average: 0.90 5.26 7.22 1/388 1735812
2024/09/04 20:59:20 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 7
[sweet] Running benchmark tile38 for baseline: run 7
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
2024/09/05 04:16:33 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2024-09-18 14:38 gotip-linux-amd64_c2s16-perf_vs_release go@3dc146da [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2024/09/18 14:41:13 Load average: 8.75 3.03 1.09 1/389 24097
2024/09/18 14:41:13 Waiting for load average to drop below 0.20...
2024/09/18 14:41:43 Load average: 5.30 2.74 1.05 1/389 24097
2024/09/18 14:41:43 Waiting for load average to drop below 0.20...
2024/09/18 14:42:13 Load average: 3.27 2.49 1.02 1/389 24097
2024/09/18 14:42:13 Waiting for load average to drop below 0.20...
2024/09/18 14:42:43 Load average: 1.98 2.25 0.99 1/389 24097
2024/09/18 14:42:43 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks, see log for details
2024/09/18 21:12:33 Error running sweet: error running sweet run: exit status 1
2024/09/18 21:12:33 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2024-11-21 02:17 gotip-linux-amd64_c2s16-perf_vs_release go@f9698788 [build] (log)
[W2024-11-21T02:53:02.934445Z 1833589 0 json_subtract.go:121] Unknown fields while parsing property namespace "": {"is_google":true}
2024/11/21 02:53:02 run starting
2024/11/21 02:53:04 installed tools
[E2024-11-21T02:53:12.589301Z 1833589 0 errors.go:128] set status: FAILURE: failed to fetch commit time for https://go.googlesource.com/go/+/f96987888f343e708c31e42356ba61715ee1f437: gc.Log: rpc error: code = Unavailable desc = service unavailable
  with SummaryMarkdown:
* go on master ([commit f969878](https://go.googlesource.com/go/+/f96987888f343e708c31e42356ba61715ee1f437))

Error: `failed to fetch commit time for https://go.googlesource.com/go/+/f96987888f343e708c31e42356ba61715ee1f437: gc.Log: rpc error: code = Unavailable desc = service unavailable`

Additional links for debugging:

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-01-28 18:54 gotip-linux-amd64_c2s16-perf_vs_release go@78e6f2a1 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/01/28 18:57:40 Load average: 7.51 2.56 0.92 1/419 30315
2025/01/28 18:57:40 Waiting for load average to drop below 0.20...
2025/01/28 18:58:10 Load average: 4.63 2.33 0.89 2/419 30315
2025/01/28 18:58:10 Waiting for load average to drop below 0.20...
2025/01/28 18:58:40 Load average: 2.80 2.11 0.87 1/417 30315
2025/01/28 18:58:40 Waiting for load average to drop below 0.20...
2025/01/28 18:59:10 Load average: 1.70 1.91 0.84 1/417 30315
2025/01/28 18:59:10 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: cockroachdb go-build
2025/01/28 21:40:46 Error running sweet: error running sweet run: exit status 1
2025/01/28 21:40:46 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-13 10:42 gotip-linux-amd64_c2s16-perf_vs_release go@3e0f9e39 [build] (log)
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading github.com/BurntSushi/toml v1.0.0
2025/02/18 15:43:34 Load average: 1.03 0.24 0.08 1/416 1923
2025/02/18 15:43:34 Waiting for load average to drop below 0.20...
2025/02/18 15:44:04 Load average: 0.84 0.27 0.09 1/414 1923
2025/02/18 15:44:04 Waiting for load average to drop below 0.20...
2025/02/18 15:44:34 Load average: 0.51 0.24 0.09 1/414 1923
2025/02/18 15:44:34 Waiting for load average to drop below 0.20...
2025/02/18 15:45:04 Load average: 0.31 0.22 0.09 1/414 1923
2025/02/18 15:45:04 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 7
[sweet] Running benchmark tile38 for baseline: run 7
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
2025/02/18 22:39:55 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-26 22:48 gotip-linux-amd64_c2s16-perf_vs_release go@c594762a [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 00:00:59 Load average: 0.22 0.05 0.01 1/419 1028279
2025/02/27 00:00:59 Waiting for load average to drop below 0.20...
2025/02/27 00:01:29 Load average: 0.25 0.07 0.02 1/419 1028279
2025/02/27 00:01:29 Waiting for load average to drop below 0.20...
2025/02/27 00:01:59 Load average: 0.15 0.07 0.02 1/419 1028279
2025/02/27 00:01:59 Running Go test benchmarks for experiment
go: downloading github.com/blevesearch/bleve v1.0.14
go: downloading github.com/dustin/go-wikiparse v0.0.0-20211018054215-c01ec186f20c
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 06:42:25 Error running sweet: error running sweet run: exit status 1
2025/02/27 06:42:25 FAIL
exit status 1
2025-02-27 01:35 gotip-linux-amd64_c2s16-perf_vs_release go@11c847e5 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 07:48:44 Load average: 1.94 6.09 7.48 1/413 3725931
2025/02/27 07:48:44 Waiting for load average to drop below 0.20...
2025/02/27 07:49:14 Load average: 1.32 5.54 7.25 1/413 3725931
2025/02/27 07:49:14 Waiting for load average to drop below 0.20...
2025/02/27 07:49:44 Load average: 0.80 5.01 7.02 1/413 3725931
2025/02/27 07:49:44 Waiting for load average to drop below 0.20...
2025/02/27 07:50:14 Load average: 0.48 4.53 6.79 1/413 3725931
2025/02/27 07:50:14 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 14:31:20 Error running sweet: error running sweet run: exit status 1
2025/02/27 14:31:20 FAIL
exit status 1
2025-02-27 01:36 gotip-linux-amd64_c2s16-perf_vs_release go@01ba8bfe [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 06:43:13 Load average: 0.30 0.07 0.02 1/379 1449149
2025/02/27 06:43:13 Waiting for load average to drop below 0.20...
2025/02/27 06:43:43 Load average: 0.32 0.09 0.03 1/379 1449149
2025/02/27 06:43:43 Waiting for load average to drop below 0.20...
2025/02/27 06:44:13 Load average: 0.20 0.08 0.03 1/379 1449149
2025/02/27 06:44:13 Waiting for load average to drop below 0.20...
2025/02/27 06:44:43 Load average: 0.12 0.07 0.02 1/379 1449149
2025/02/27 06:44:43 Running Go test benchmarks for experiment
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 13:31:23 Error running sweet: error running sweet run: exit status 1
2025/02/27 13:31:23 FAIL
exit status 1
2025-02-27 11:47 gotip-linux-amd64_c2s16-perf_vs_release go@37e9c5ea [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 13:32:14 Load average: 0.54 0.12 0.04 1/421 3684224
2025/02/27 13:32:14 Waiting for load average to drop below 0.20...
2025/02/27 13:32:44 Load average: 0.53 0.15 0.05 1/421 3684224
2025/02/27 13:32:44 Waiting for load average to drop below 0.20...
2025/02/27 13:33:14 Load average: 0.32 0.14 0.05 1/421 3684224
2025/02/27 13:33:14 Waiting for load average to drop below 0.20...
2025/02/27 13:33:44 Load average: 0.19 0.12 0.05 1/421 3684224
2025/02/27 13:33:44 Running Go test benchmarks for experiment
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 20:17:26 Error running sweet: error running sweet run: exit status 1
2025/02/27 20:17:26 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-27 14:05 gotip-linux-amd64_c2s16-perf_vs_release go@2b737073 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 14:31:59 Load average: 0.22 0.05 0.15 1/368 1844
2025/02/27 14:31:59 Waiting for load average to drop below 0.20...
2025/02/27 14:32:29 Load average: 0.27 0.08 0.16 1/368 1844
2025/02/27 14:32:29 Waiting for load average to drop below 0.20...
2025/02/27 14:32:59 Load average: 0.16 0.07 0.15 1/368 1844
2025/02/27 14:32:59 Running Go test benchmarks for experiment
go: downloading github.com/yuin/gopher-lua v0.0.0-20210529063254-f4c35e4016d9
go: downloading github.com/blevesearch/bleve v1.0.14
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 21:19:38 Error running sweet: error running sweet run: exit status 1
2025/02/27 21:19:38 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-27 14:05 gotip-linux-amd64_c2s16-perf_vs_release go@0ab2253c [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 14:52:30 Load average: 3.65 6.72 7.84 1/414 507282
2025/02/27 14:52:30 Waiting for load average to drop below 0.20...
2025/02/27 14:53:00 Load average: 2.36 6.11 7.60 1/414 507282
2025/02/27 14:53:00 Waiting for load average to drop below 0.20...
2025/02/27 14:53:30 Load average: 1.48 5.54 7.36 1/415 507282
2025/02/27 14:53:30 Waiting for load average to drop below 0.20...
2025/02/27 14:54:00 Load average: 0.90 5.01 7.12 1/415 507282
2025/02/27 14:54:00 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 21:43:25 Error running sweet: error running sweet run: exit status 1
2025/02/27 21:43:25 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-27 17:23 gotip-linux-amd64_c2s16-perf_vs_release go@d31c8055 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 20:18:20 Load average: 0.13 0.03 0.01 1/415 1683
2025/02/27 20:18:20 Running Go test benchmarks for experiment
go: downloading github.com/blevesearch/bleve v1.0.14
go: downloading github.com/biogo/biogo v1.0.4
go: downloading golang.org/x/sync v0.11.0
go: downloading gitlab.com/golang-commonmark/markdown v0.0.0-20211110145824-bf3e522c626a
go: downloading github.com/dustin/go-wikiparse v0.0.0-20211018054215-c01ec186f20c
go: downloading github.com/gomodule/redigo v1.8.5
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 03:00:29 Error running sweet: error running sweet run: exit status 1
2025/02/28 03:00:29 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-27 15:57 gotip-linux-amd64_c2s16-perf_vs_release go@01351209 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 21:20:30 Load average: 0.31 0.07 0.02 1/418 1920
2025/02/27 21:20:30 Waiting for load average to drop below 0.20...
2025/02/27 21:21:00 Load average: 0.34 0.09 0.03 1/418 1920
2025/02/27 21:21:00 Waiting for load average to drop below 0.20...
2025/02/27 21:21:30 Load average: 0.32 0.11 0.04 1/419 1920
2025/02/27 21:21:30 Waiting for load average to drop below 0.20...
2025/02/27 21:22:00 Load average: 0.19 0.10 0.04 1/420 1920
2025/02/27 21:22:00 Running Go test benchmarks for experiment
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 04:09:09 Error running sweet: error running sweet run: exit status 1
2025/02/28 04:09:09 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-27 14:04 gotip-linux-amd64_c2s16-perf_vs_release go@1f7e28ac [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 21:44:08 Load average: 0.15 0.08 1.74 1/374 1531
2025/02/27 21:44:08 Running Go test benchmarks for experiment
go: downloading github.com/biogo/biogo v1.0.4
go: downloading github.com/yuin/gopher-lua v0.0.0-20210529063254-f4c35e4016d9
go: downloading go.etcd.io/etcd/client/v3 v3.5.8
go: downloading gitlab.com/golang-commonmark/markdown v0.0.0-20211110145824-bf3e522c626a
go: downloading golang.org/x/sync v0.11.0
go: downloading github.com/blevesearch/bleve v1.0.14
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 04:28:09 Error running sweet: error running sweet run: exit status 1
2025/02/28 04:28:09 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-27 13:58 gotip-linux-amd64_c2s16-perf_vs_release go@f8f08bfd [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/28 03:01:27 Load average: 0.15 0.04 0.01 1/411 1022560
2025/02/28 03:01:27 Running Go test benchmarks for experiment
go: downloading go.etcd.io/etcd/client/v3 v3.5.8
go: downloading github.com/biogo/biogo v1.0.4
go: downloading github.com/blevesearch/bleve v1.0.14
go: downloading github.com/dustin/go-wikiparse v0.0.0-20211018054215-c01ec186f20c
go: downloading github.com/google/pprof v0.0.0-20241017200806-017d972448fc
go: downloading golang.org/x/sync v0.11.0
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 09:47:09 Error running sweet: error running sweet run: exit status 1
2025/02/28 09:47:09 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-27 13:50 gotip-linux-amd64_c2s16-perf_vs_release go@763766e9 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/28 04:29:00 Load average: 1.45 0.33 0.11 1/417 1531
2025/02/28 04:29:00 Waiting for load average to drop below 0.20...
2025/02/28 04:29:30 Load average: 1.16 0.36 0.12 1/418 1531
2025/02/28 04:29:30 Waiting for load average to drop below 0.20...
2025/02/28 04:30:00 Load average: 0.70 0.32 0.12 1/418 1531
2025/02/28 04:30:00 Waiting for load average to drop below 0.20...
2025/02/28 04:30:30 Load average: 0.42 0.29 0.11 1/418 1531
2025/02/28 04:30:30 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 11:16:19 Error running sweet: error running sweet run: exit status 1
2025/02/28 11:16:19 FAIL
exit status 1
2025-02-27 13:58 gotip-linux-amd64_c2s16-perf_vs_release go@872496da [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/28 04:10:02 Load average: 0.15 0.04 0.01 1/414 1959
2025/02/28 04:10:02 Running Go test benchmarks for experiment
go: downloading github.com/blevesearch/bleve v1.0.14
go: downloading github.com/dustin/go-wikiparse v0.0.0-20211018054215-c01ec186f20c
go: downloading github.com/biogo/biogo v1.0.4
go: downloading github.com/yuin/gopher-lua v0.0.0-20210529063254-f4c35e4016d9
go: downloading golang.org/x/sync v0.11.0
go: downloading gitlab.com/golang-commonmark/markdown v0.0.0-20211110145824-bf3e522c626a
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 10:51:42 Error running sweet: error running sweet run: exit status 1
2025/02/28 10:51:42 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-27 13:49 gotip-linux-amd64_c2s16-perf_vs_release go@b66d83cc [build] (log)
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading github.com/BurntSushi/toml v1.0.0
2025/02/28 09:47:49 Load average: 0.39 0.08 0.03 1/415 1859259
2025/02/28 09:47:49 Waiting for load average to drop below 0.20...
2025/02/28 09:48:19 Load average: 0.46 0.12 0.04 2/415 1859259
2025/02/28 09:48:19 Waiting for load average to drop below 0.20...
2025/02/28 09:48:49 Load average: 0.28 0.11 0.04 1/415 1859259
2025/02/28 09:48:49 Waiting for load average to drop below 0.20...
2025/02/28 09:49:19 Load average: 0.17 0.10 0.04 1/415 1859259
2025/02/28 09:49:19 Running Go test benchmarks for experiment
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 16:29:06 Error running sweet: error running sweet run: exit status 1
2025/02/28 16:29:06 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-linux-amd64_c2s16-perf_vs_release" && repo == "go" && mode == "build"
2025-02-27 11:45 gotip-linux-amd64_c2s16-perf_vs_release go@927fdb78 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/28 10:52:30 Load average: 0.50 0.11 0.04 1/419 1045165
2025/02/28 10:52:30 Waiting for load average to drop below 0.20...
2025/02/28 10:53:00 Load average: 0.48 0.15 0.05 1/419 1045165
2025/02/28 10:53:00 Waiting for load average to drop below 0.20...
2025/02/28 10:53:30 Load average: 0.29 0.13 0.05 1/419 1045165
2025/02/28 10:53:30 Waiting for load average to drop below 0.20...
2025/02/28 10:54:00 Load average: 0.17 0.12 0.05 1/419 1045165
2025/02/28 10:54:00 Running Go test benchmarks for experiment
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 17:39:14 Error running sweet: error running sweet run: exit status 1
2025/02/28 17:39:14 FAIL
exit status 1

watchflakes

@prattmic
Copy link
Member

gotip-linux-amd64_c2s16-perf_vs_release and gotip-linux-amd64_c3h88-perf_vs_release are failing continuously since https://go.dev/cl/652276.

The logging is bad, I can't see the real failure beyond "warning: failed to wait for server: exit status 2"

I think this is a panic. gVisor knows the procid offset (https://cs.opensource.google/gvisor/gvisor/+/master:pkg/hosttid/hosttid_amd64.s;l=21), and https://go.dev/cl/652276 changed to offset.

I propose we disable the gVisor benchmark until gVisor upstream is fixed.

cc @mknyszek

@dmitshur dmitshur moved this to Active in Test Flakes Feb 28, 2025
@dmitshur dmitshur added this to the Go1.25 milestone Feb 28, 2025
@dmitshur dmitshur changed the title build: build failure on gotip-linux-amd64_c2s16-perf_vs_release build: build failure on gotip-linux-amd64_[…]-perf_vs_release due to "failed to execute benchmarks: gvisor" Feb 28, 2025
@dmitshur dmitshur changed the title build: build failure on gotip-linux-amd64_[…]-perf_vs_release due to "failed to execute benchmarks: gvisor" build: build failure on linux-amd64_[…]-perf_vs_release due to "failed to execute benchmarks: gvisor" Feb 28, 2025
@dmitshur dmitshur marked this as a duplicate of #70479 Feb 28, 2025
@dmitshur dmitshur marked this as a duplicate of #69009 Feb 28, 2025
@dmitshur dmitshur marked this as a duplicate of #68452 Feb 28, 2025
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder ~ `linux-amd64_.+-perf_vs_release$` && repo == "go" && mode == "build" && `error: failed to execute benchmarks: gvisor`
2025-02-14 17:38 gotip-linux-amd64_c3h88-perf_vs_release go@242ef7cb [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/14 21:01:26 Load average: 0.23 0.05 0.02 1/1075 2330
2025/02/14 21:01:26 Waiting for load average to drop below 0.20...
2025/02/14 21:01:56 Load average: 0.22 0.06 0.02 1/1075 2330
2025/02/14 21:01:56 Waiting for load average to drop below 0.20...
2025/02/14 21:02:26 Load average: 0.18 0.07 0.02 1/1075 2330
2025/02/14 21:02:26 Running Go test benchmarks for experiment
go: downloading github.com/blevesearch/bleve v1.0.14
go: downloading go.etcd.io/etcd/client/v3 v3.5.8
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/15 02:39:29 Error running sweet: error running sweet run: exit status 1
2025/02/15 02:39:29 FAIL
exit status 1
2025-02-26 22:48 gotip-linux-amd64_c3h88-perf_vs_release go@c594762a [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 00:46:20 Load average: 10.44 17.49 16.49 1/1093 2451994
2025/02/27 00:46:20 Waiting for load average to drop below 0.20...
2025/02/27 00:46:50 Load average: 6.39 15.84 15.97 1/1093 2451994
2025/02/27 00:46:50 Waiting for load average to drop below 0.20...
2025/02/27 00:47:20 Load average: 3.87 14.32 15.46 1/1093 2451994
2025/02/27 00:47:20 Waiting for load average to drop below 0.20...
2025/02/27 00:47:50 Load average: 2.35 12.95 14.97 1/1092 2451994
2025/02/27 00:47:50 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 06:21:54 Error running sweet: error running sweet run: exit status 1
2025/02/27 06:21:54 FAIL
exit status 1
2025-02-27 01:35 gotip-linux-amd64_c3h88-perf_vs_release go@11c847e5 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 06:22:28 Load average: 13.76 17.60 16.49 1/1064 1749
2025/02/27 06:22:28 Waiting for load average to drop below 0.20...
2025/02/27 06:22:58 Load average: 8.42 15.94 15.97 1/1064 1749
2025/02/27 06:22:58 Waiting for load average to drop below 0.20...
2025/02/27 06:23:28 Load average: 5.10 14.41 15.46 2/1063 1749
2025/02/27 06:23:28 Waiting for load average to drop below 0.20...
2025/02/27 06:23:58 Load average: 3.09 13.03 14.97 1/1065 1749
2025/02/27 06:23:58 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 11:59:53 Error running sweet: error running sweet run: exit status 1
2025/02/27 11:59:53 FAIL
exit status 1
2025-02-27 01:36 gotip-linux-amd64_c3h88-perf_vs_release go@01ba8bfe [build] (log)
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading github.com/BurntSushi/toml v1.0.0
2025/02/27 05:15:57 Load average: 6.71 13.44 14.44 2/1089 831875
2025/02/27 05:15:57 Waiting for load average to drop below 0.20...
2025/02/27 05:16:27 Load average: 4.14 12.17 13.99 1/1089 831875
2025/02/27 05:16:27 Waiting for load average to drop below 0.20...
2025/02/27 05:16:57 Load average: 2.51 11.00 13.54 1/1088 831875
2025/02/27 05:16:57 Waiting for load average to drop below 0.20...
2025/02/27 05:17:27 Load average: 1.52 9.95 13.11 2/1088 831875
2025/02/27 05:17:27 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 10:50:39 Error running sweet: error running sweet run: exit status 1
2025/02/27 10:50:39 FAIL
exit status 1
2025-02-27 11:45 gotip-linux-amd64_c3h88-perf_vs_release go@927fdb78 [build] (log)
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading github.com/BurntSushi/toml v1.0.0
2025/02/27 12:12:23 Load average: 0.07 0.02 0.05 1/1050 2450
2025/02/27 12:12:23 Running Go test benchmarks for experiment
go: downloading github.com/biogo/biogo v1.0.4
go: downloading github.com/yuin/gopher-lua v0.0.0-20210529063254-f4c35e4016d9
go: downloading github.com/opencontainers/runtime-spec v1.0.2
go: downloading github.com/blevesearch/bleve v1.0.14
go: downloading github.com/gomodule/redigo v1.8.5
go: downloading cloud.google.com/go/storage v1.41.0
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 17:43:01 Error running sweet: error running sweet run: exit status 1
2025/02/27 17:43:01 FAIL
exit status 1
2025-02-27 11:47 gotip-linux-amd64_c3h88-perf_vs_release go@37e9c5ea [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 12:00:36 Load average: 16.29 17.99 16.37 2/1068 1757
2025/02/27 12:00:36 Waiting for load average to drop below 0.20...
2025/02/27 12:01:06 Load average: 9.94 16.29 15.85 1/1068 1757
2025/02/27 12:01:06 Waiting for load average to drop below 0.20...
2025/02/27 12:01:36 Load average: 6.03 14.73 15.35 2/1069 1757
2025/02/27 12:01:36 Waiting for load average to drop below 0.20...
2025/02/27 12:02:06 Load average: 3.65 13.32 14.86 2/1070 1757
2025/02/27 12:02:06 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 17:37:49 Error running sweet: error running sweet run: exit status 1
2025/02/27 17:37:49 FAIL
exit status 1
2025-02-27 13:49 gotip-linux-amd64_c3h88-perf_vs_release go@b66d83cc [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/28 04:49:56 Load average: 2.84 10.76 13.68 2/1067 1770
2025/02/28 04:49:56 Waiting for load average to drop below 0.20...
2025/02/28 04:50:26 Load average: 1.72 9.73 13.24 1/1067 1770
2025/02/28 04:50:26 Waiting for load average to drop below 0.20...
2025/02/28 04:50:56 Load average: 1.04 8.80 12.82 1/1067 1770
2025/02/28 04:50:56 Waiting for load average to drop below 0.20...
2025/02/28 04:51:26 Load average: 0.63 7.96 12.41 1/1067 1770
2025/02/28 04:51:26 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 10:23:28 Error running sweet: error running sweet run: exit status 1
2025/02/28 10:23:28 FAIL
exit status 1
2025-02-27 13:50 gotip-linux-amd64_c3h88-perf_vs_release go@763766e9 [build] (log)
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading github.com/BurntSushi/toml v1.0.0
2025/02/28 04:48:40 Load average: 0.08 0.02 0.22 1/1050 2325
2025/02/28 04:48:40 Running Go test benchmarks for experiment
go: downloading github.com/biogo/biogo v1.0.4
go: downloading github.com/yuin/gopher-lua v0.0.0-20210529063254-f4c35e4016d9
go: downloading github.com/google/pprof v0.0.0-20241017200806-017d972448fc
go: downloading github.com/biogo/store v0.0.0-20201120204734-aad293a2328f
go: downloading github.com/biogo/graph v0.0.0-20150317020928-057c1989faed
go: downloading gitlab.com/golang-commonmark/markdown v0.0.0-20211110145824-bf3e522c626a
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 10:18:33 Error running sweet: error running sweet run: exit status 1
2025/02/28 10:18:33 FAIL
exit status 1
2025-02-27 13:58 gotip-linux-amd64_c3h88-perf_vs_release go@872496da [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/28 03:44:25 Load average: 0.36 0.08 0.03 1/1087 4275
2025/02/28 03:44:25 Waiting for load average to drop below 0.20...
2025/02/28 03:44:55 Load average: 0.34 0.10 0.04 1/1087 4275
2025/02/28 03:44:55 Waiting for load average to drop below 0.20...
2025/02/28 03:45:25 Load average: 0.20 0.09 0.03 1/1086 4275
2025/02/28 03:45:25 Waiting for load average to drop below 0.20...
2025/02/28 03:45:55 Load average: 0.12 0.08 0.03 1/1087 4275
2025/02/28 03:45:55 Running Go test benchmarks for experiment
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 09:19:04 Error running sweet: error running sweet run: exit status 1
2025/02/28 09:19:04 FAIL
exit status 1
2025-02-27 13:58 gotip-linux-amd64_c3h88-perf_vs_release go@f8f08bfd [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 23:16:43 Load average: 0.78 7.46 12.89 2/1071 1795
2025/02/27 23:16:43 Waiting for load average to drop below 0.20...
2025/02/27 23:17:13 Load average: 0.55 6.76 12.48 1/1058 1795
2025/02/27 23:17:13 Waiting for load average to drop below 0.20...
2025/02/27 23:17:43 Load average: 0.33 6.11 12.08 1/1058 1795
2025/02/27 23:17:43 Waiting for load average to drop below 0.20...
2025/02/27 23:18:13 Load average: 0.20 5.53 11.70 1/1058 1795
2025/02/27 23:18:13 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 04:49:17 Error running sweet: error running sweet run: exit status 1
2025/02/28 04:49:17 FAIL
exit status 1
2025-02-27 14:04 gotip-linux-amd64_c3h88-perf_vs_release go@1f7e28ac [build] (log)
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading github.com/BurntSushi/toml v1.0.0
2025/02/27 23:12:11 Load average: 3.52 0.77 0.25 1/1083 2503419
2025/02/27 23:12:11 Waiting for load average to drop below 0.20...
2025/02/27 23:12:41 Load average: 2.27 0.73 0.25 2/1083 2503419
2025/02/27 23:12:41 Waiting for load average to drop below 0.20...
2025/02/27 23:13:11 Load average: 1.38 0.66 0.25 1/1083 2503419
2025/02/27 23:13:11 Waiting for load average to drop below 0.20...
2025/02/27 23:13:41 Load average: 0.83 0.59 0.24 1/1083 2503419
2025/02/27 23:13:41 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 04:47:42 Error running sweet: error running sweet run: exit status 1
2025/02/28 04:47:42 FAIL
exit status 1
2025-02-27 14:05 gotip-linux-amd64_c3h88-perf_vs_release go@0ab2253c [build] (log)
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading github.com/BurntSushi/toml v1.0.0
2025/02/27 22:09:10 Load average: 1.17 0.26 0.09 2/1073 4245
2025/02/27 22:09:10 Waiting for load average to drop below 0.20...
2025/02/27 22:09:40 Load average: 0.85 0.27 0.09 1/1073 4245
2025/02/27 22:09:40 Waiting for load average to drop below 0.20...
2025/02/27 22:10:10 Load average: 0.51 0.24 0.09 1/1073 4245
2025/02/27 22:10:10 Waiting for load average to drop below 0.20...
2025/02/27 22:10:40 Load average: 0.31 0.22 0.09 1/1073 4245
2025/02/27 22:10:40 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/28 03:43:47 Error running sweet: error running sweet run: exit status 1
2025/02/28 03:43:47 FAIL
exit status 1
2025-02-27 14:05 gotip-linux-amd64_c3h88-perf_vs_release go@2b737073 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 17:43:37 Load average: 0.15 6.38 12.19 2/1064 1801
2025/02/27 17:43:37 Running Go test benchmarks for experiment
go: downloading github.com/blevesearch/bleve v1.0.14
go: downloading github.com/google/pprof v0.0.0-20241017200806-017d972448fc
go: downloading go.etcd.io/etcd/client/v3 v3.5.8
go: downloading github.com/biogo/biogo v1.0.4
go: downloading github.com/biogo/store v0.0.0-20201120204734-aad293a2328f
go: downloading github.com/biogo/graph v0.0.0-20150317020928-057c1989faed
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 23:15:58 Error running sweet: error running sweet run: exit status 1
2025/02/27 23:15:58 FAIL
exit status 1
2025-02-27 15:57 gotip-linux-amd64_c3h88-perf_vs_release go@01351209 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 16:32:22 Load average: 14.37 17.60 16.61 2/1089 2504951
2025/02/27 16:32:22 Waiting for load average to drop below 0.20...
2025/02/27 16:32:52 Load average: 8.79 15.93 16.08 1/1090 2504952
2025/02/27 16:32:52 Waiting for load average to drop below 0.20...
2025/02/27 16:33:22 Load average: 5.33 14.41 15.57 1/1090 2504952
2025/02/27 16:33:22 Waiting for load average to drop below 0.20...
2025/02/27 16:33:52 Load average: 3.23 13.03 15.07 2/1090 2504952
2025/02/27 16:33:52 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 22:08:29 Error running sweet: error running sweet run: exit status 1
2025/02/27 22:08:29 FAIL
exit status 1
2025-02-27 17:23 gotip-linux-amd64_c3h88-perf_vs_release go@d31c8055 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/27 17:38:26 Load average: 0.54 0.12 0.04 2/1098 827418
2025/02/27 17:38:26 Waiting for load average to drop below 0.20...
2025/02/27 17:38:56 Load average: 0.41 0.12 0.04 1/1098 827418
2025/02/27 17:38:56 Waiting for load average to drop below 0.20...
2025/02/27 17:39:26 Load average: 0.25 0.11 0.04 1/1098 827418
2025/02/27 17:39:26 Waiting for load average to drop below 0.20...
2025/02/27 17:39:56 Load average: 0.15 0.10 0.03 1/1098 827418
2025/02/27 17:39:56 Running Go test benchmarks for experiment
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/02/27 23:11:33 Error running sweet: error running sweet run: exit status 1
2025/02/27 23:11:33 FAIL
exit status 1

watchflakes

@dmitshur dmitshur added NeedsFix The path to resolution is known, but the work has not been done. and removed NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Feb 28, 2025
@gopherbot
Copy link
Contributor Author

Change https://go.dev/cl/653755 mentions this issue: sweet: disable gVisor by default

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder ~ `linux-amd64_.+-perf_vs_release$` && repo == "go" && mode == "build" && `error: failed to execute benchmarks: gvisor`
2025-02-28 16:48 gotip-linux-amd64_c2s16-perf_vs_release go@55597473 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/28 18:14:07 Load average: 1.36 0.30 0.10 1/415 2295
2025/02/28 18:14:07 Waiting for load average to drop below 0.20...
2025/02/28 18:14:37 Load average: 1.12 0.33 0.11 1/415 2295
2025/02/28 18:14:37 Waiting for load average to drop below 0.20...
2025/02/28 18:15:07 Load average: 0.73 0.32 0.11 1/415 2295
2025/02/28 18:15:07 Waiting for load average to drop below 0.20...
2025/02/28 18:15:37 Load average: 0.44 0.28 0.11 1/415 2295
2025/02/28 18:15:37 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/03/01 00:57:35 Error running sweet: error running sweet run: exit status 1
2025/03/01 00:57:35 FAIL
exit status 1
2025-02-28 16:54 gotip-linux-amd64_c2s16-perf_vs_release go@6e8d7a11 [build] (log)
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading github.com/BurntSushi/toml v1.0.0
2025/02/28 17:40:16 Load average: 0.27 0.06 0.02 1/397 5519
2025/02/28 17:40:16 Waiting for load average to drop below 0.20...
2025/02/28 17:40:46 Load average: 0.38 0.11 0.04 1/397 5519
2025/02/28 17:40:46 Waiting for load average to drop below 0.20...
2025/02/28 17:41:16 Load average: 0.23 0.09 0.03 1/396 5519
2025/02/28 17:41:16 Waiting for load average to drop below 0.20...
2025/02/28 17:41:46 Load average: 0.14 0.08 0.03 1/396 5519
2025/02/28 17:41:46 Running Go test benchmarks for experiment
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/03/01 00:23:26 Error running sweet: error running sweet run: exit status 1
2025/03/01 00:23:26 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder ~ `linux-amd64_.+-perf_vs_release$` && repo == "go" && mode == "build" && `error: failed to execute benchmarks: gvisor`
2025-02-28 19:09 gotip-linux-amd64_c3h88-perf_vs_release go@74ba2164 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/28 20:48:19 Load average: 0.62 7.97 12.20 2/1093 829424
2025/02/28 20:48:19 Waiting for load average to drop below 0.20...
2025/02/28 20:48:49 Load average: 0.45 7.22 11.82 1/1093 829424
2025/02/28 20:48:49 Waiting for load average to drop below 0.20...
2025/02/28 20:49:19 Load average: 0.27 6.53 11.44 1/1093 829424
2025/02/28 20:49:19 Waiting for load average to drop below 0.20...
2025/02/28 20:49:49 Load average: 0.16 5.90 11.08 1/1094 829424
2025/02/28 20:49:49 Running Go test benchmarks for experiment
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/03/01 02:21:41 Error running sweet: error running sweet run: exit status 1
2025/03/01 02:21:41 FAIL
exit status 1
2025-02-28 20:43 gotip-linux-amd64_c3h88-perf_vs_release go@64feded8 [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/28 21:41:48 Load average: 7.44 17.04 16.40 2/1091 2509772
2025/02/28 21:41:48 Waiting for load average to drop below 0.20...
2025/02/28 21:42:18 Load average: 4.58 15.42 15.88 1/1091 2509772
2025/02/28 21:42:18 Waiting for load average to drop below 0.20...
2025/02/28 21:42:48 Load average: 2.83 13.96 15.38 1/1091 2509772
2025/02/28 21:42:48 Waiting for load average to drop below 0.20...
2025/02/28 21:43:18 Load average: 1.71 12.63 14.89 1/1091 2509772
2025/02/28 21:43:18 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/03/01 03:17:50 Error running sweet: error running sweet run: exit status 1
2025/03/01 03:17:50 FAIL
exit status 1

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder ~ `linux-amd64_.+-perf_vs_release$` && repo == "go" && mode == "build" && `error: failed to execute benchmarks: gvisor`
2025-02-28 20:43 gotip-linux-amd64_c3h88-perf_vs_release go@2298215f [build] (log)
go: downloading github.com/BurntSushi/toml v1.0.0
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
2025/02/28 21:46:13 Load average: 13.51 18.61 16.46 3/1066 821793
2025/02/28 21:46:13 Waiting for load average to drop below 0.20...
2025/02/28 21:46:43 Load average: 8.24 16.85 15.94 1/1067 821793
2025/02/28 21:46:43 Waiting for load average to drop below 0.20...
2025/02/28 21:47:13 Load average: 4.99 15.24 15.43 1/1067 821793
2025/02/28 21:47:13 Waiting for load average to drop below 0.20...
2025/02/28 21:47:43 Load average: 3.02 13.78 14.94 1/1067 821793
2025/02/28 21:47:43 Waiting for load average to drop below 0.20...
...
[sweet] Running benchmark tile38 for experiment: run 8
[sweet] Running benchmark tile38 for baseline: run 8
[sweet] Running benchmark tile38 for experiment: run 9
[sweet] Running benchmark tile38 for baseline: run 9
[sweet] Running benchmark tile38 for experiment: run 10
[sweet] Running benchmark tile38 for baseline: run 10
[sweet] error: failed to execute benchmarks: gvisor
2025/03/01 03:22:26 Error running sweet: error running sweet run: exit status 1
2025/03/01 03:22:26 FAIL
exit status 1

watchflakes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NeedsFix The path to resolution is known, but the work has not been done.
Projects
Status: Done
Development

No branches or pull requests

3 participants