You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Following tonight's incident (the sweep endlessly re-visiting already-reviewed PRs, fixed in #4474, and a downstream cache-fingerprint bug this surfaced, fixed in #4481), we ran a second, broader audit specifically looking for the SAME classes of bug elsewhere in the review engine: unbounded/excessive periodic re-processing, AI-capability cache-coverage gaps, non-deterministic queries silently defeating a hash/fingerprint or eviction policy, redundant GitHub API calls within a single pass, and queue/cron scheduling waste (missing rate-limit admission or job dedup).
Every finding below was independently adversarially verified against the actual current source (not just claimed) before being tracked here — one candidate finding out of 14 was refuted and dropped. This is a real, evidenced backlog, not speculation.
Non-goals
This epic is about correctness and resource waste, not new features. No new AI capabilities, no new public-facing surfaces.
Findings that were investigated and found to be already-correctly-guarded (e.g. ai_review/ai_slop's existing frozen-reuse/pause mechanisms) are explicitly NOT re-litigated here.
Sub-issues (priority order — fix top-down for biggest impact first)
Every fix in this epic must ship with invariant tests AND a regression test named for the specific bug, not just a happy-path check — this whole epic exists because a prior generation of similar bugs shipped without tests that would have caught the exact failure mode. Each sub-issue's own Requirements section restates this specifically for its bug.
Expected outcome
Every confirmed waste/correctness gap from tonight's audit fixed or explicitly tracked with a clear priority, each with regression coverage so this class of bug cannot silently reappear.
Effort
Epic — 12 independently shippable sub-issues, roughly 1-3 days total depending on how many are tackled.
Motivation
Following tonight's incident (the sweep endlessly re-visiting already-reviewed PRs, fixed in #4474, and a downstream cache-fingerprint bug this surfaced, fixed in #4481), we ran a second, broader audit specifically looking for the SAME classes of bug elsewhere in the review engine: unbounded/excessive periodic re-processing, AI-capability cache-coverage gaps, non-deterministic queries silently defeating a hash/fingerprint or eviction policy, redundant GitHub API calls within a single pass, and queue/cron scheduling waste (missing rate-limit admission or job dedup).
Every finding below was independently adversarially verified against the actual current source (not just claimed) before being tracked here — one candidate finding out of 14 was refuted and dropped. This is a real, evidenced backlog, not speculation.
Non-goals
ai_review/ai_slop's existing frozen-reuse/pause mechanisms) are explicitly NOT re-litigated here.Sub-issues (priority order — fix top-down for biggest impact first)
Standing requirement for every sub-issue
Every fix in this epic must ship with invariant tests AND a regression test named for the specific bug, not just a happy-path check — this whole epic exists because a prior generation of similar bugs shipped without tests that would have caught the exact failure mode. Each sub-issue's own Requirements section restates this specifically for its bug.
Expected outcome
Every confirmed waste/correctness gap from tonight's audit fixed or explicitly tracked with a clear priority, each with regression coverage so this class of bug cannot silently reappear.
Effort
Epic — 12 independently shippable sub-issues, roughly 1-3 days total depending on how many are tackled.