Skip to content

fix(night-shift): Remove poll timeout that aborted Explorer runs#113137

Merged
trevor-e merged 1 commit intomasterfrom
trevor-e/fix/night-shift-poll-timeout
Apr 15, 2026
Merged

fix(night-shift): Remove poll timeout that aborted Explorer runs#113137
trevor-e merged 1 commit intomasterfrom
trevor-e/fix/night-shift-poll-timeout

Conversation

@trevor-e
Copy link
Copy Markdown
Member

The polling loop in _poll_with_logging raised a TimeoutError after 120s, which caused the entire night shift run to be abandoned for an org — even though the Explorer was still actively working on the Seer side. For large orgs like Sentry (70 eligible projects, 10 candidates), the Explorer can legitimately need more than 120s to investigate all candidates.

In the observed incident (SENTRY-5NFV), the Explorer had finished analyzing all issues and was writing its final verdicts when the timeout killed the run at 121.3s.

This removes the client-side poll timeout entirely. The task's own processing_deadline_duration (5 minutes) serves as the backstop. There's no cancel API on the Explorer client, so a client-side timeout only wastes the Seer-side work that continues running regardless.

Fixes SENTRY-5NFV

The polling loop in agentic triage raised a TimeoutError after 120s,
which abandoned the entire night shift run for an org even though the
Explorer was still working on the Seer side. For large orgs like Sentry
the Explorer can take longer than 120s to investigate all candidates.

Remove the client-side poll timeout and let the task's own processing
deadline (5 minutes) be the backstop instead.

Fixes SENTRY-5NFV
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@github-actions github-actions Bot added the Scope: Backend Automatically applied to PRs that change backend components label Apr 15, 2026
@trevor-e trevor-e marked this pull request as ready for review April 15, 2026 23:27
@trevor-e trevor-e requested a review from a team as a code owner April 15, 2026 23:27
@trevor-e trevor-e merged commit edeeb63 into master Apr 15, 2026
57 checks passed
@trevor-e trevor-e deleted the trevor-e/fix/night-shift-poll-timeout branch April 15, 2026 23:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Scope: Backend Automatically applied to PRs that change backend components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants