Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build: frequent "unexpected stale targets" on linux-arm-arm5spacemonkey after bootstrapping is complete #35740

Closed
bcmills opened this issue Nov 21, 2019 · 13 comments
Labels
Builders NeedsInvestigation
Milestone

Comments

@bcmills bcmills added Builders NeedsInvestigation labels Nov 21, 2019
@bcmills bcmills added this to the Backlog milestone Nov 21, 2019
@bcmills
Copy link
Member Author

@bcmills bcmills commented Dec 18, 2019

This failure mode is now happening on every build.

@esnolte, you are listed as the owner of that builder here. Could you please investigate?

I wonder if the problem is somehow that multiple builds are running at the same time. (A similar failure mode in #35749 turned out to be an older builder running concurrently with the current one.)

@esnolte
Copy link

@esnolte esnolte commented Dec 18, 2019

@esnolte
Copy link

@esnolte esnolte commented Dec 18, 2019

@bcmills
Copy link
Member Author

@bcmills bcmills commented Dec 19, 2019

That doesn't seem to have fixed the problem. (https://build.golang.org/log/08d3ac2849287e18678df797c542b7329dab3d3e)

@esnolte
Copy link

@esnolte esnolte commented Dec 19, 2019

@bcmills
Copy link
Member Author

@bcmills bcmills commented Dec 19, 2019

Hmm, now https://farmer.golang.org/ shows 0/2 host-linux-arm5spacemonkey hosts available, but lists them both as connected:

Reverse pool by host type (in use / total)

  • […]
  • host-linux-arm5spacemonkey: 0/2 (1 missing)
  • go-builder-1 (69.58.94.166:38292) version 24, host-linux-arm5spacemonkey: connected 50m45.9s, idle for 3.41s
  • go-builder-2 (69.58.94.166:27320) version 24, host-linux-arm5spacemonkey: connected 1h18m43.9s, idle for 10.2s
  • linux-arm-arm5spacemonkey rev a197c7b; waiting_for_machine, 2m28s ago

@dmitshur
Copy link
Contributor

@dmitshur dmitshur commented Dec 19, 2019

I've unplugged a rogue builder we no longer have access to (go-builder-3). It looks like the other 2 builders are passing tests.

By now, this seems to be accurately reflected under the "Reverse pool by host type (in use / total)" section of https://farmer.golang.org/#pools:

host-linux-arm5spacemonkey: 2/2 (1 missing)

I'm not sure why it was showing something else before.

@esnolte
Copy link

@esnolte esnolte commented Dec 19, 2019

@ianlancetaylor
Copy link
Contributor

@ianlancetaylor ianlancetaylor commented Dec 23, 2019

The original problem is still happening.

@bradfitz
Copy link
Contributor

@bradfitz bradfitz commented Dec 27, 2019

IIRC, the arm5 builders start with a cross-compiled make.bash from a linux-amd64 machine. Perhaps the two environments have drifted?

@esnolte
Copy link

@esnolte esnolte commented Jan 21, 2020

@gopherbot
Copy link

@gopherbot gopherbot commented Aug 31, 2021

Change https://golang.org/cl/346530 mentions this issue: dashboard: remove linux-arm-arm5spacemonkey

gopherbot pushed a commit to golang/build that referenced this issue Aug 31, 2021
This removes the linux-arm-arm5spacemonkey builders. They have been
missing for an extended period of time and there is no timeline for fixing them.

Updates golang/go#35740
Fixes golang/go#41027

Change-Id: I4a7bdbf890f4a35201a826d2049693dd2eec6524
Reviewed-on: https://go-review.googlesource.com/c/build/+/346530
Trust: Carlos Amedee <carlos@golang.org>
Run-TryBot: Carlos Amedee <carlos@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@golang.org>
TryBot-Result: Go Bot <gobot@golang.org>
@cagedmantis
Copy link
Contributor

@cagedmantis cagedmantis commented Aug 31, 2021

Closing this issue as the associated builder has been removed as part of #41027.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Builders NeedsInvestigation
Projects
None yet
Development

No branches or pull requests

7 participants