cmd/dist: unexpected staleness on netbsd-arm64-bsiegert

[gopherbot]

#!watchflakes
post <- builder == "netbsd-arm64-bsiegert" && section == "" && pkg == "" && test == "" && `STALE`

Issue created automatically to collect these failures.

Example (log):

HASH[moduleIndex]
HASH[moduleIndex]: "devel 40bdcbb483548c0b660503c3ba80f9676b98fd5f"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel 40bdcbb483548c0b660503c3ba80f9676b98fd5f go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-11-14 14:33:22 +0000 UTC 1324\n"
HASH[moduleIndex]: "file build.go 2022-11-14 14:33:22 +0000 UTC 50774\n"
HASH[moduleIndex]: "file buildgo.go 2022-11-14 14:33:22 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-11-14 14:33:22 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-11-14 14:33:22 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-11-14 14:33:22 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- builder == "netbsd-arm64-bsiegert" && section == "" && pkg == "" && test == ""

2022-11-14 14:32 netbsd-arm64-bsiegert go@40bdcbb4 (log)

HASH[moduleIndex]
HASH[moduleIndex]: "devel 40bdcbb483548c0b660503c3ba80f9676b98fd5f"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel 40bdcbb483548c0b660503c3ba80f9676b98fd5f go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-11-14 14:33:22 +0000 UTC 1324\n"
HASH[moduleIndex]: "file build.go 2022-11-14 14:33:22 +0000 UTC 50774\n"
HASH[moduleIndex]: "file buildgo.go 2022-11-14 14:33:22 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-11-14 14:33:22 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-11-14 14:33:22 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-11-14 14:33:22 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

2022-11-14 18:47 netbsd-arm64-bsiegert go@01d12c94 (log)

HASH[moduleIndex]
HASH[moduleIndex]: "devel 01d12c947c2277a46477597c2148083744ccf284"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel 01d12c947c2277a46477597c2148083744ccf284 go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-11-14 18:51:58 +0000 UTC 1324\n"
HASH[moduleIndex]: "file build.go 2022-11-14 18:51:58 +0000 UTC 50774\n"
HASH[moduleIndex]: "file buildgo.go 2022-11-14 18:51:58 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-11-14 18:51:58 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-11-14 18:51:58 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-11-14 18:51:58 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

2022-11-21 21:55 netbsd-arm64-bsiegert go@089dcd7b (log)

HASH[moduleIndex]
HASH[moduleIndex]: "devel 089dcd7b07f047e29d8a2f6e3a68aba00ec78de6"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel 089dcd7b07f047e29d8a2f6e3a68aba00ec78de6 go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-11-23 16:43:51 +0000 UTC 1341\n"
HASH[moduleIndex]: "file build.go 2022-11-23 16:43:51 +0000 UTC 50069\n"
HASH[moduleIndex]: "file buildgo.go 2022-11-23 16:43:51 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-11-23 16:43:51 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-11-23 16:43:51 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-11-23 16:43:51 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

— watchflakes

[bcmills]

This looks very similar to the cgo non-reproducibility reported for aix in #56896.

@bsiegert, is it possible that this builder does not have fully-reproducible cgo builds, perhaps due to an issue with the C toolchain?

[bcmills]

(CC @golang/netbsd)

[bsiegert]

I don't know why that would be the case. From what I can see, this happened on both machines. The RPi (the hostname is rpi4) was updated a few days ago to the latest NetBSD-current because its SD card broke. It now has a hard drive instead. The other machine has not been changed in months.

The fact that this happened now and hasn't happened before suggests that the root cause is something else. Was there any change in Go that could have triggered this?

[bcmills]

The fact that this happened now and hasn't happened before suggests that the root cause is something else. Was there any change in Go that could have triggered this?

The trigger could be CL 452457 / #47257. Prior to that CL, cgo reproducibility problems would have been masked on the builders, because the cgo packages in std were included in GOROOT/pkg, redistributed to the builder, and reused as-is without re-running the system's C toolchain.

That said, I'm not sure why commands like cmd/test2json would be affected — do those depend on cgo or the C toolchain on netbsd/arm64?

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- builder == "netbsd-arm64-bsiegert" && section == "" && pkg == "" && test == "" && `STALE`

2022-11-28 16:27 netbsd-arm64-bsiegert go@0a8055ef (log)

HASH[moduleIndex]
HASH[moduleIndex]: "devel 0a8055ef3f84673dc3a70ce5143bdf9817986dea"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel 0a8055ef3f84673dc3a70ce5143bdf9817986dea go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-11-29 01:03:42 +0000 UTC 1341\n"
HASH[moduleIndex]: "file build.go 2022-11-29 01:03:42 +0000 UTC 50069\n"
HASH[moduleIndex]: "file buildgo.go 2022-11-29 01:03:42 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-11-29 01:03:42 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-11-29 01:03:42 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-11-29 01:03:42 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

2022-11-28 23:32 netbsd-arm64-bsiegert go@a4772376 (log)

HASH[moduleIndex]
HASH[moduleIndex]: "devel a4772376af5821c5c341ce9de49628d10d60971b"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel a4772376af5821c5c341ce9de49628d10d60971b go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-11-28 23:32:54 +0000 UTC 1341\n"
HASH[moduleIndex]: "file build.go 2022-11-28 23:32:54 +0000 UTC 50069\n"
HASH[moduleIndex]: "file buildgo.go 2022-11-28 23:32:54 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-11-28 23:32:54 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-11-28 23:32:54 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-11-28 23:32:54 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

2022-11-29 01:18 netbsd-arm64-bsiegert go@0fd7be7e (log)

HASH[moduleIndex]
HASH[moduleIndex]: "devel 0fd7be7ee5f36215b5d6b8f23f35d60bf749805a"
HASH[moduleIndex]: "modroot /var/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel 0fd7be7ee5f36215b5d6b8f23f35d60bf749805a go index v1 /var/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-11-29 01:19:10 +0000 UTC 1341\n"
HASH[moduleIndex]: "file build.go 2022-11-29 01:19:10 +0000 UTC 50069\n"
HASH[moduleIndex]: "file buildgo.go 2022-11-29 01:19:10 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-11-29 01:19:10 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-11-29 01:19:10 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-11-29 01:19:10 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- builder == "netbsd-arm64-bsiegert" && section == "" && pkg == "" && test == "" && `STALE`

2022-12-05 22:29 netbsd-arm64-bsiegert go@0b323a3c (log)

HASH[moduleIndex]
HASH[moduleIndex]: "devel 0b323a3c1690050340fc8e39730a07bb01373f0a"
HASH[moduleIndex]: "modroot /var/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel 0b323a3c1690050340fc8e39730a07bb01373f0a go index v1 /var/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-12-05 22:30:19 +0000 UTC 1341\n"
HASH[moduleIndex]: "file build.go 2022-12-05 22:30:19 +0000 UTC 50355\n"
HASH[moduleIndex]: "file buildgo.go 2022-12-05 22:30:19 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-12-05 22:30:19 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-12-05 22:30:19 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-12-05 22:30:19 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

— watchflakes

[gopherbot]

Found new dashboard test flakes for:

#!watchflakes
post <- builder == "netbsd-arm64-bsiegert" && section == "" && pkg == "" && test == "" && `STALE`

2022-11-07 19:27 netbsd-arm64-bsiegert go@92c7df11 (log)

HASH[moduleIndex]
HASH[moduleIndex]: "devel 92c7df116ecbd8f230b48f72eb44fa7de5d13233"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel 92c7df116ecbd8f230b48f72eb44fa7de5d13233 go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-11-07 19:28:15 +0000 UTC 1324\n"
HASH[moduleIndex]: "file build.go 2022-11-07 19:28:15 +0000 UTC 50365\n"
HASH[moduleIndex]: "file buildgo.go 2022-11-07 19:28:15 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-11-07 19:28:15 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-11-07 19:28:15 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-11-07 19:28:15 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

2022-11-08 18:44 netbsd-arm64-bsiegert go@39ac1fbd (log)

HASH[moduleIndex]
HASH[moduleIndex]: "go1.19.3"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package go1.19.3 go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-11-08 18:44:46 +0000 UTC 1324\n"
HASH[moduleIndex]: "file build.go 2022-11-08 18:44:46 +0000 UTC 49763\n"
HASH[moduleIndex]: "file buildgo.go 2022-11-08 18:44:46 +0000 UTC 3489\n"
HASH[moduleIndex]: "file buildruntime.go 2022-11-08 18:44:46 +0000 UTC 3265\n"
HASH[moduleIndex]: "file buildtag.go 2022-11-08 18:44:46 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-11-08 18:44:46 +0000 UTC 1257\n"
...
	STALE cmd/go: build ID mismatch
	STALE cmd/gofmt: build ID mismatch
	STALE cmd/link: build ID mismatch
	STALE cmd/nm: build ID mismatch
	STALE cmd/objdump: build ID mismatch
	STALE cmd/pack: build ID mismatch
	STALE cmd/pprof: build ID mismatch
	STALE cmd/test2json: build ID mismatch
	STALE cmd/trace: build ID mismatch
	STALE cmd/vet: build ID mismatch

2022-11-09 18:44 netbsd-arm64-bsiegert go@a3dce127 (log)

HASH[build internal/goarch]
HASH[build internal/goarch]: "go1.18.8"
HASH[build internal/goarch]: "compile\n"
HASH[build internal/goarch]: "goos netbsd goarch arm64\n"
HASH[build internal/goarch]: "import \"internal/goarch\"\n"
HASH[build internal/goarch]: "omitdebug false standard true local false prefix \"\"\n"
HASH[build internal/goarch]: "modinfo \"\"\n"
HASH[build internal/cpu]
HASH[build internal/cpu]: "go1.18.8"
HASH[build internal/cpu]: "compile\n"
...
	STALE cmd/go: build ID mismatch
	STALE cmd/gofmt: build ID mismatch
	STALE cmd/link: build ID mismatch
	STALE cmd/nm: build ID mismatch
	STALE cmd/objdump: build ID mismatch
	STALE cmd/pack: build ID mismatch
	STALE cmd/pprof: build ID mismatch
	STALE cmd/test2json: build ID mismatch
	STALE cmd/trace: build ID mismatch
	STALE cmd/vet: build ID mismatch

2022-12-05 16:41 netbsd-arm64-bsiegert go@ad55b878 (log)

HASH[moduleIndex]
HASH[moduleIndex]: "devel ad55b878e7d5c641aec1c07bb549742e76c77208"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel ad55b878e7d5c641aec1c07bb549742e76c77208 go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-12-05 16:42:11 +0000 UTC 1341\n"
HASH[moduleIndex]: "file build.go 2022-12-05 16:42:11 +0000 UTC 50355\n"
HASH[moduleIndex]: "file buildgo.go 2022-12-05 16:42:11 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-12-05 16:42:11 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-12-05 16:42:11 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-12-05 16:42:11 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

2022-12-06 19:00 netbsd-arm64-bsiegert go@76cad4ed (log)

HASH[build internal/goarch]
HASH[build internal/unsafeheader]
HASH[build internal/goexperiment]
HASH[build internal/goexperiment]: "go1.18.8"
HASH[build internal/goexperiment]: "compile\n"
HASH[build internal/goexperiment]: "goos netbsd goarch arm64\n"
HASH[build internal/goexperiment]: "import \"internal/goexperiment\"\n"
HASH[build internal/goexperiment]: "omitdebug false standard true local false prefix \"\"\n"
HASH[build internal/goexperiment]: "modinfo \"\"\n"
HASH[build internal/unsafeheader]: "go1.18.8"
...
	STALE cmd/go: build ID mismatch
	STALE cmd/gofmt: build ID mismatch
	STALE cmd/link: build ID mismatch
	STALE cmd/nm: build ID mismatch
	STALE cmd/objdump: build ID mismatch
	STALE cmd/pack: build ID mismatch
	STALE cmd/pprof: build ID mismatch
	STALE cmd/test2json: build ID mismatch
	STALE cmd/trace: build ID mismatch
	STALE cmd/vet: build ID mismatch

2022-12-06 19:00 netbsd-arm64-bsiegert go@618120c1 (log)

HASH[moduleIndex]
HASH[moduleIndex]: "go1.19.3"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package go1.19.3 go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-12-07 07:45:00 +0000 UTC 1324\n"
HASH[moduleIndex]: "file build.go 2022-12-07 07:45:00 +0000 UTC 49763\n"
HASH[moduleIndex]: "file buildgo.go 2022-12-07 07:45:00 +0000 UTC 3489\n"
HASH[moduleIndex]: "file buildruntime.go 2022-12-07 07:45:00 +0000 UTC 3265\n"
HASH[moduleIndex]: "file buildtag.go 2022-12-07 07:45:00 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-12-07 07:45:00 +0000 UTC 1257\n"
...
	STALE cmd/go: build ID mismatch
	STALE cmd/gofmt: build ID mismatch
	STALE cmd/link: build ID mismatch
	STALE cmd/nm: build ID mismatch
	STALE cmd/objdump: build ID mismatch
	STALE cmd/pack: build ID mismatch
	STALE cmd/pprof: build ID mismatch
	STALE cmd/test2json: build ID mismatch
	STALE cmd/trace: build ID mismatch
	STALE cmd/vet: build ID mismatch

2022-12-06 19:30 netbsd-arm64-bsiegert go@dc04f3ba (log)

HASH[moduleIndex]
HASH[moduleIndex]: "go1.19.4"
HASH[moduleIndex]: "modroot /var/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package go1.19.4 go index v1 /var/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-12-06 19:31:21 +0000 UTC 1324\n"
HASH[moduleIndex]: "file build.go 2022-12-06 19:31:21 +0000 UTC 49763\n"
HASH[moduleIndex]: "file buildgo.go 2022-12-06 19:31:21 +0000 UTC 3489\n"
HASH[moduleIndex]: "file buildruntime.go 2022-12-06 19:31:21 +0000 UTC 3265\n"
HASH[moduleIndex]: "file buildtag.go 2022-12-06 19:31:21 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-12-06 19:31:21 +0000 UTC 1257\n"
...
	STALE cmd/go: build ID mismatch
	STALE cmd/gofmt: build ID mismatch
	STALE cmd/link: build ID mismatch
	STALE cmd/nm: build ID mismatch
	STALE cmd/objdump: build ID mismatch
	STALE cmd/pack: build ID mismatch
	STALE cmd/pprof: build ID mismatch
	STALE cmd/test2json: build ID mismatch
	STALE cmd/trace: build ID mismatch
	STALE cmd/vet: build ID mismatch

2022-12-09 20:04 netbsd-arm64-bsiegert go@c2a2fbab (log)

HASH[moduleIndex]
HASH[moduleIndex]: "go1.19.4"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package go1.19.4 go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-12-10 03:10:14 +0000 UTC 1324\n"
HASH[moduleIndex]: "file build.go 2022-12-10 03:10:14 +0000 UTC 49763\n"
HASH[moduleIndex]: "file buildgo.go 2022-12-10 03:10:14 +0000 UTC 3489\n"
HASH[moduleIndex]: "file buildruntime.go 2022-12-10 03:10:14 +0000 UTC 3265\n"
HASH[moduleIndex]: "file buildtag.go 2022-12-10 03:10:14 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-12-10 03:10:14 +0000 UTC 1257\n"
...
	STALE cmd/go: build ID mismatch
	STALE cmd/gofmt: build ID mismatch
	STALE cmd/link: build ID mismatch
	STALE cmd/nm: build ID mismatch
	STALE cmd/objdump: build ID mismatch
	STALE cmd/pack: build ID mismatch
	STALE cmd/pprof: build ID mismatch
	STALE cmd/test2json: build ID mismatch
	STALE cmd/trace: build ID mismatch
	STALE cmd/vet: build ID mismatch

2022-12-09 21:06 netbsd-arm64-bsiegert go@926ffba4 (log)

HASH[moduleIndex]
HASH[moduleIndex]: "go1.19.4"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package go1.19.4 go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-12-09 21:07:12 +0000 UTC 1324\n"
HASH[moduleIndex]: "file build.go 2022-12-09 21:07:12 +0000 UTC 49763\n"
HASH[moduleIndex]: "file buildgo.go 2022-12-09 21:07:12 +0000 UTC 3489\n"
HASH[moduleIndex]: "file buildruntime.go 2022-12-09 21:07:12 +0000 UTC 3265\n"
HASH[moduleIndex]: "file buildtag.go 2022-12-09 21:07:12 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-12-09 21:07:12 +0000 UTC 1257\n"
...
	STALE cmd/go: build ID mismatch
	STALE cmd/gofmt: build ID mismatch
	STALE cmd/link: build ID mismatch
	STALE cmd/nm: build ID mismatch
	STALE cmd/objdump: build ID mismatch
	STALE cmd/pack: build ID mismatch
	STALE cmd/pprof: build ID mismatch
	STALE cmd/test2json: build ID mismatch
	STALE cmd/trace: build ID mismatch
	STALE cmd/vet: build ID mismatch

2022-12-19 21:44 netbsd-arm64-bsiegert go@7683c71a (log)

HASH[moduleIndex]
HASH[moduleIndex]: "go1.19.4"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package go1.19.4 go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-12-19 21:44:42 +0000 UTC 1324\n"
HASH[moduleIndex]: "file build.go 2022-12-19 21:44:42 +0000 UTC 49763\n"
HASH[moduleIndex]: "file buildgo.go 2022-12-19 21:44:42 +0000 UTC 3489\n"
HASH[moduleIndex]: "file buildruntime.go 2022-12-19 21:44:42 +0000 UTC 3265\n"
HASH[moduleIndex]: "file buildtag.go 2022-12-19 21:44:42 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-12-19 21:44:42 +0000 UTC 1257\n"
...
	STALE cmd/go: build ID mismatch
	STALE cmd/gofmt: build ID mismatch
	STALE cmd/link: build ID mismatch
	STALE cmd/nm: build ID mismatch
	STALE cmd/objdump: build ID mismatch
	STALE cmd/pack: build ID mismatch
	STALE cmd/pprof: build ID mismatch
	STALE cmd/test2json: build ID mismatch
	STALE cmd/trace: build ID mismatch
	STALE cmd/vet: build ID mismatch

2022-12-22 19:21 netbsd-arm64-bsiegert go@07b6ffb7 (log)

HASH[build internal/goarch]
HASH[build internal/goarch]: "go1.18.9"
HASH[build internal/goarch]: "compile\n"
HASH[build internal/goarch]: "goos netbsd goarch arm64\n"
HASH[build internal/goarch]: "import \"internal/goarch\"\n"
HASH[build internal/goarch]: "omitdebug false standard true local false prefix \"\"\n"
HASH[build internal/goarch]: "modinfo \"\"\n"
HASH[build internal/cpu]
HASH[build internal/cpu]: "go1.18.9"
HASH[build internal/cpu]: "compile\n"
...
	STALE cmd/go: build ID mismatch
	STALE cmd/gofmt: build ID mismatch
	STALE cmd/link: build ID mismatch
	STALE cmd/nm: build ID mismatch
	STALE cmd/objdump: build ID mismatch
	STALE cmd/pack: build ID mismatch
	STALE cmd/pprof: build ID mismatch
	STALE cmd/test2json: build ID mismatch
	STALE cmd/trace: build ID mismatch
	STALE cmd/vet: build ID mismatch

2022-12-27 21:10 netbsd-arm64-bsiegert go@e870de99 (log)

HASH[moduleIndex]
HASH[moduleIndex]: "devel e870de9936a7efa42ac1915ff4ffb16017dbc819"
HASH[moduleIndex]: "modroot /scratch/gobuilder/buildlet/go/src/cmd\n"
HASH[moduleIndex]: "package devel e870de9936a7efa42ac1915ff4ffb16017dbc819 go index v1 /scratch/gobuilder/buildlet/go/src/cmd/dist\n"
HASH[moduleIndex]: "file README 2022-12-27 21:18:24 +0000 UTC 1341\n"
HASH[moduleIndex]: "file build.go 2022-12-27 21:18:24 +0000 UTC 50355\n"
HASH[moduleIndex]: "file buildgo.go 2022-12-27 21:18:24 +0000 UTC 3495\n"
HASH[moduleIndex]: "file buildruntime.go 2022-12-27 21:18:24 +0000 UTC 2630\n"
HASH[moduleIndex]: "file buildtag.go 2022-12-27 21:18:24 +0000 UTC 3077\n"
HASH[moduleIndex]: "file buildtag_test.go 2022-12-27 21:18:24 +0000 UTC 1257\n"
...
	STALE cmd/go: not installed but available in build cache
	STALE cmd/gofmt: not installed but available in build cache
	STALE cmd/link: not installed but available in build cache
	STALE cmd/nm: not installed but available in build cache
	STALE cmd/objdump: not installed but available in build cache
	STALE cmd/pack: not installed but available in build cache
	STALE cmd/pprof: not installed but available in build cache
	STALE cmd/test2json: not installed but available in build cache
	STALE cmd/trace: not installed but available in build cache
	STALE cmd/vet: not installed but available in build cache

— watchflakes