Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build: coordinator tracks dead reverse buildlets for a long time #12666

Closed
crawshaw opened this issue Sep 17, 2015 · 5 comments

Comments

Projects
None yet
3 participants
@crawshaw
Copy link
Contributor

commented Sep 17, 2015

Only four darwin machines are online right now (the maximum at any time has been 7, and inparticular gomacmini-e has been off for 30 minutes), but farmer.golang.org shows:

Reverse pool summary
darwin-386-10_10: 49/49 (6 + 43 other)
darwin-amd64-10_10: 49/49 (32 + 17 other)
darwin-arm-a5ios: 36/36 (7 + 29 other)
darwin-arm64-a7ios: 32/32 (4 + 28 other)

Reverse pool machine detail
gomacmini-e.local (104.132.34.69:42310) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 3h17m35.814826002s, working as darwin-386-10_10 for 3h17m33.867126261s
gomacmini-e.local (104.132.34.69:32930) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 3h9m36.521373513s, working as darwin-386-10_10 for 3h9m33.86407025s
gomacmini-e.local (104.132.34.69:49153) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 3h3m30.606904575s, working as darwin-amd64-10_10 for 3h3m18.579129036s
gomacmini-e.local (104.132.34.69:61736) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h55m6.401503471s, working as darwin-386-10_10 for 2h55m3.857367117s
gomacmini-e.local (104.132.34.69:58089) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h48m59.307176275s, working as darwin-arm-a5ios for 2h48m48.279092615s
gomacmini-e.local (104.132.34.69:39529) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h48m43.409707113s, working as darwin-386-10_10 for 2h48m33.854782253s
gomacmini-e.local (104.132.34.69:42258) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h38m13.116669338s, working as darwin-arm64-a7ios for 2h38m3.851248607s
gomacmini-e.local (104.132.34.69:42043) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h37m58.516398101s, working as darwin-386-10_10 for 2h37m48.4884505s
gomacmini-e.local (104.132.34.69:42896) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h27m28.154881367s, working as darwin-amd64-10_10 for 2h27m15.126495727s
gomacmini-e.local (104.132.34.69:49605) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h18m14.785819292s, working as darwin-arm-a5ios for 2h18m3.843837063s
...
@crawshaw

This comment has been minimized.

Copy link
Contributor Author

commented Sep 17, 2015

@bradfitz

This comment has been minimized.

Copy link
Member

commented Sep 17, 2015

On it in 3 hours.

Please capture /debug/goroutines for me in the meantime.

@crawshaw

This comment has been minimized.

Copy link
Contributor Author

commented Sep 17, 2015

In your email (too big for github).

bradfitz added a commit to golang/build that referenced this issue Sep 17, 2015

buildlet: try a bit harder to cancel slow HTTP requests
Use the new Go 1.5 mechanism to abort HTTP requests with a channel.
This is respected by the Go 1.5 http.Transport, which we always use.

This CL shouldn't be necessary (CL 14700 was the real bug), but
doesn't hurt. This still would've probably prevented most of
golang/go#12666

Change-Id: I6890e016ee04183fc0d600baed8046c2f79113d8
Reviewed-on: https://go-review.googlesource.com/14701
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
@bradfitz

This comment has been minimized.

Copy link
Member

commented Sep 17, 2015

Not yet fixed.

@bradfitz bradfitz reopened this Sep 17, 2015

@bradfitz bradfitz self-assigned this Sep 17, 2015

@bradfitz bradfitz added the Builders label Sep 17, 2015

@bradfitz bradfitz added this to the Unplanned milestone Sep 17, 2015

@bradfitz

This comment has been minimized.

Copy link
Member

commented Sep 18, 2015

@bradfitz bradfitz closed this Sep 18, 2015

@golang golang locked and limited conversation to collaborators Sep 22, 2016

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
You can’t perform that action at this time.