Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build: trybot hang after finish_fetch_snapshot_reader_from_buildlet #18812

Closed
bradfitz opened this issue Jan 27, 2017 · 3 comments

Comments

Projects
None yet
3 participants
@bradfitz
Copy link
Member

commented Jan 27, 2017

Trybot set hung waiting on a kubernetes builder:

	
nacl-amd64p32 rev a5a1618b (trybot set for I49b2663); running; http://10.0.1.5 Kube Pod: buildlet-nacl-kube-rnb747993, 45m45.931745721s ago
  2017-01-27T14:33:34Z checking_for_snapshot 
  2017-01-27T14:33:34Z finish_checking_for_snapshot after 51.32275ms
  2017-01-27T14:33:34Z get_buildlet 
  2017-01-27T14:33:34Z creating_kube_pod buildlet-nacl-kube-rnb747993
  2017-01-27T14:33:34Z pod_creating 
  2017-01-27T14:33:39Z pod_created 
  2017-01-27T14:33:39Z got_pod_info waiting_for_buildlet...
  2017-01-27T14:33:39Z finish_get_buildlet after 5.141578314s
  2017-01-27T14:33:39Z using_buildlet 10.0.1.5:80
  2017-01-27T14:33:39Z write_version_tar 
  2017-01-27T14:33:39Z get_source 
  2017-01-27T14:33:40Z finish_get_source after 401.2781ms
  2017-01-27T14:33:40Z write_go_src_tar 
  2017-01-27T14:33:41Z finish_write_go_src_tar after 1.029514167s
  2017-01-27T14:33:41Z make_and_test 
  2017-01-27T14:33:41Z make src/naclmake.bash
  2017-01-27T14:34:41Z starting_helpers 
  2017-01-27T14:34:41Z get_helper helper 1/3
  2017-01-27T14:34:41Z get_helper helper 2/3
  2017-01-27T14:34:41Z creating_kube_pod buildlet-nacl-kube-rnb989c8a
  2017-01-27T14:34:41Z creating_kube_pod buildlet-nacl-kube-rn03a60f4
  2017-01-27T14:34:41Z get_helper helper 3/3
  2017-01-27T14:34:41Z creating_kube_pod buildlet-nacl-kube-rncc94f03
  2017-01-27T14:34:41Z pod_creating 
  2017-01-27T14:34:41Z pod_creating 
  2017-01-27T14:34:41Z pod_creating 
  2017-01-27T14:34:46Z pod_created 
  2017-01-27T14:34:46Z got_pod_info waiting_for_buildlet...
  2017-01-27T14:34:46Z pod_created 
  2017-01-27T14:34:46Z got_pod_info waiting_for_buildlet...
  2017-01-27T14:34:46Z pod_created 
  2017-01-27T14:34:46Z got_pod_info waiting_for_buildlet...
  2017-01-27T14:34:46Z finish_get_helper after 5.051645859s; helper 3/3
  2017-01-27T14:34:46Z empty_helper_ready 10.0.1.8:80
  2017-01-27T14:34:46Z finish_get_helper after 5.04074738s; helper 2/3
  2017-01-27T14:34:46Z empty_helper_ready 10.0.4.118:80
  2017-01-27T14:34:46Z finish_get_helper after 5.055263941s; helper 1/3
  2017-01-27T14:34:46Z empty_helper_ready 10.0.3.226:80
  2017-01-27T14:34:56Z finish_make after 1m14.60644189s; src/naclmake.bash
  2017-01-27T14:34:56Z clean_for_snapshot 
  2017-01-27T14:34:56Z finish_clean_for_snapshot after 29.63942ms
  2017-01-27T14:34:56Z write_snapshot_to_gcs 
  2017-01-27T14:34:56Z fetch_snapshot_reader_from_buildlet 
  2017-01-27T14:34:56Z finish_fetch_snapshot_reader_from_buildlet after 60.162053ms
 +2663.8s (now)

Missing deadline somewhere?

@bradfitz bradfitz added the Builders label Jan 27, 2017

@bradfitz bradfitz self-assigned this Jan 27, 2017

@bradfitz bradfitz changed the title x/build: x/build: trybot hang after finish_fetch_snapshot_reader_from_buildlet Jan 27, 2017

@bradfitz bradfitz added this to the Unreleased milestone Jan 27, 2017

@bradfitz

This comment has been minimized.

Copy link
Member Author

commented Feb 11, 2017

Looks like func (*golang.org/x/build/buildlet.Client).GetTar(dir string) should take a context and use it.

/cc @kevinburke (interested?)

@kevinburke

This comment has been minimized.

Copy link
Contributor

commented Feb 11, 2017

@gopherbot

This comment has been minimized.

Copy link

commented Feb 12, 2017

CL https://golang.org/cl/36897 mentions this issue.

@golang golang locked and limited conversation to collaborators Feb 12, 2018

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
You can’t perform that action at this time.