💡 Agentic Activity Circuit Breakers and Org-Wide Rate Limiting Standard #586
Replies: 2 comments
-
|
Consider token usage/budget as a primary metric for throttling/rate limiting. A Frequent undocumented issue is the depletion of token budgets. Current agents have visibility, consideration or limits related to budget, resulting in failed runs and depleted budgets that fully block work for agents and humans. Goal: Pause agentic work when the 5 hour budget reaches 90%. Claude as priority. |
Beta Was this translation helpful? Give feedback.
-
|
📋 Initiative planned by the BMAD Scrum Master (Bob). Epic #636 — Agentic Activity Circuit Breakers & Org-Wide Rate-Limiting Standard 5 stories created (inert — labelled
Open questions for review:
Review the epic and its sub-issue DAG, adjust as needed, then add |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Summary
Define and enforce org-wide rate limits, circuit breakers, and resource budgets for autonomous CI agents (dev-lead, compliance-audit, feature-ideation, initiative-driver) to prevent cascading failures, resource exhaustion, and runaway automation. This addresses real bugs already observed in production — 111 issues stuck from dev-lead concurrency group cancellation (#402) and dispatch races (#443) — with a systematic framework rather than per-incident patches.
Market Signal
User Signal
Three real production failures demonstrate the need:
These are all symptoms of the same underlying problem: autonomous agents operating without throughput controls, deadline awareness, or graceful degradation.
Technical Opportunity
The org already has the foundational patterns:
pr-limit-gate.sh— source-side queue-depth admission controlstandards/pr-limits.json— machine-readable config, single source of truthExtending this pattern to per-agent-type rate limits and circuit breakers can be implemented in the reusable workflow templates without changing the agent logic itself:
timeout-minutes+ monitorThe Actions Data Stream (on GitHub's 2026 roadmap) would provide the telemetry backend for monitoring these limits.
Assessment
pr-limit-gate.shpattern; no new infrastructure requiredAdversarial Review
Strongest objection: PR-limits just shipped (#505). Adding more limits risks throttling legitimate automation and slowing development velocity.
Rebuttal: PR-limits is a queue-depth control (how many items in the queue). Rate limiting is a throughput control (how fast the queue is processed). They're complementary, not redundant — a system with a 50-PR queue cap but no execution-rate limit can still have 50 agents race to process that queue simultaneously. The real bugs (#402, #443, #571) prove that execution-level controls are needed. Well-designed circuit breakers don't slow legitimate work — they prevent the runaway scenarios that make ALL work slower (like 111 stuck issues blocking the entire pipeline).
Suggested Next Step
Define per-agent-type limits (max concurrent runs, max runtime, daily budget, cooldown period) in a new
standards/agent-rate-limits.jsonconfig file and implement them as a reusable shell library inscripts/lib/agent-rate-limit.sh, mirroring thepr-limit-gate.shpattern.Beta Was this translation helpful? Give feedback.
All reactions