Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build/cmd/coordinator/internal/lucipoll, x/build/cmd/watchflakes: occasionally gets stuck (for upwards of 24 hrs) #66687

Open
dmitshur opened this issue Apr 4, 2024 · 1 comment
Assignees
Labels
Builders x/build issues (builders, bots, dashboards) NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Milestone

Comments

@dmitshur
Copy link
Contributor

dmitshur commented Apr 4, 2024

The pollLoop method that runs in a loop usually takes a minute, but sometimes seems to get stuck and eventually completes in just over 24 hours without any error. This is a tracking issue to sort this out.

@dmitshur dmitshur added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Apr 4, 2024
@dmitshur dmitshur added this to the Unreleased milestone Apr 4, 2024
@dmitshur dmitshur self-assigned this Apr 4, 2024
@gopherbot
Copy link
Contributor

Change https://go.dev/cl/576658 mentions this issue: cmd/coordinator/internal/lucipoll: retry after 30 minutes

gopherbot pushed a commit to golang/build that referenced this issue Apr 5, 2024
We're still seeing instances where runOnce takes significantly longer
to complete than usual. Add a hard timeout to get more information and
maybe act as a stop-gap to reduce how often build results are missing.

For golang/go#66687.

Change-Id: I5ecddf53d776bd35230eaec0621e0850a5a3cc3e
Reviewed-on: https://go-review.googlesource.com/c/build/+/576658
Auto-Submit: Dmitri Shuralyov <dmitshur@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Reviewed-by: Michael Knyszek <mknyszek@google.com>
@dmitshur dmitshur changed the title cmd/coordinator/internal/lucipoll: occasionally gets stuck (for upwards of 24 hrs) x/build/cmd/coordinator/internal/lucipoll, x/build/cmd/watchflakes: occasionally gets stuck (for upwards of 24 hrs) Apr 19, 2024
@gopherbot gopherbot added the Builders x/build issues (builders, bots, dashboards) label Apr 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Builders x/build issues (builders, bots, dashboards) NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Projects
Status: Planned
Development

No branches or pull requests

2 participants