Replies: 1 comment
|
Thank you for your interest in contributing to our community! We currently only accept discussions created through the GitHub UI using our provided discussion templates. Please re-submit your discussion by navigating to the appropriate category and using the template provided. This discussion has been closed because it was not submitted through the expected format. If you believe this was a mistake, please reach out to the maintainers. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Summary
Since July 30, 2026, roughly a quarter of our scheduled jobs on
ubuntu-latestare killed in the first ~90 seconds, before any workflow step reports a failure. Runs that survive that window complete normally in 13–15 minutes. There is no middle ground — we have no "slow" runs, only killed-early or normal.Measurements
100 most recent runs of one workflow. Job duration measured
startedAt→completedAt(not runcreatedAt→updatedAt, which sums retries and inflates everything).Durations of the 16 kills, in seconds:
11 of 16 died between 75 and 96 seconds with no step marked as failed — the job dies during setup, before any of our steps report. The remaining 5 died between 136 and 231 s, and there the failed step is simply whichever one happened to be running; it varies between attempts of the same run.
Two distinct annotation signatures, same underlying event
The runner has received a shutdown signal…and/orThe operation was canceled.— with run conclusionfailure(nobody cancelled anything).Process completed with exit code 143(SIGTERM), with neither of the above.Signature 2 is worth flagging on its own: any retry automation keyed on the "shutdown signal" / "was canceled" strings will silently miss it. Ours did, and runs sat unretried until someone noticed by hand.
What we ruled out
137(SIGKILL); we consistently see143.cancelled; all of these concludefailure.Other observations
Environment
ubuntu-latest, GitHub-hosted, private repository, single job, typical successful runtime 13–15 min.Question
Is this a known reclamation/recycling behaviour on hosted runners, and is there anything on our side that can make a job survive that first window? Run IDs available on request (private repo).
All reactions