Skip to content

chore(supergroups-backfill): Reduce lightweight backfill batch size and delay#112761

Merged
yuvmen merged 1 commit into
masterfrom
yuvmen/chore/backfill-batch-size-delay
Apr 11, 2026
Merged

chore(supergroups-backfill): Reduce lightweight backfill batch size and delay#112761
yuvmen merged 1 commit into
masterfrom
yuvmen/chore/backfill-batch-size-delay

Conversation

@yuvmen
Copy link
Copy Markdown
Member

@yuvmen yuvmen commented Apr 11, 2026

Seer's lightweight RCA endpoint queues a Celery task and returns in ~20ms, so the bottleneck is Seer processing capacity not request latency. Reduce batch size to 25 and increase delay to 10s to give Seer time to process queued tasks between batches and avoid overloading its worker pool.

@github-actions github-actions Bot added the Scope: Backend Automatically applied to PRs that change backend components label Apr 11, 2026
@yuvmen yuvmen marked this pull request as ready for review April 11, 2026 00:31
@yuvmen yuvmen requested a review from a team as a code owner April 11, 2026 00:32
Copy link
Copy Markdown
Contributor

@cvxluo cvxluo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we could even consider going slower, since it would be a lot easier to wait longer for the backfill to process then to recover from something terrible happening

@yuvmen yuvmen force-pushed the yuvmen/chore/backfill-batch-size-delay branch from 27a6cf2 to 4e86705 Compare April 11, 2026 00:41
Copy link
Copy Markdown
Contributor

@cursor cursor Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 4e86705. Configure here.

Comment thread src/sentry/tasks/seer/backfill_supergroups_lightweight.py
Comment thread src/sentry/tasks/seer/backfill_supergroups_lightweight.py
Seer's lightweight RCA endpoint queues a Celery task and returns in
~20ms, so the bottleneck is Seer processing capacity not request
latency. Reduce batch size to 25 and increase delay to 5s to give
Seer time to process queued tasks between batches and avoid
overloading its worker pool.
@yuvmen yuvmen force-pushed the yuvmen/chore/backfill-batch-size-delay branch from 4e86705 to 1386ff3 Compare April 11, 2026 00:45
@yuvmen yuvmen merged commit a6cee27 into master Apr 11, 2026
56 checks passed
@yuvmen yuvmen deleted the yuvmen/chore/backfill-batch-size-delay branch April 11, 2026 01:28
wedamija pushed a commit that referenced this pull request Apr 13, 2026
…nd delay (#112761)

Seer's lightweight RCA endpoint queues a Celery task and returns in
~20ms, so the bottleneck is Seer processing capacity not request
latency. Reduce batch size to 25 and increase delay to 10s to give Seer
time to process queued tasks between batches and avoid overloading its
worker pool.
@github-actions github-actions Bot locked and limited conversation to collaborators Apr 26, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

Scope: Backend Automatically applied to PRs that change backend components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants