[detection-analysis] Detection Analysis Report — 2026-09-09

[github-actions[bot]]

Summary

• Window evaluated: last 24 full hours (UTC), 2026-09-08T23:33:55Z → 2026-09-09T23:33:55Z
• Total runs analyzed: 314
• Detection-enabled runs: 313 (99.7%)
• Regular runs (gh-aw-detection: false): 1 (0.3%)
• Misconfigured workflows found: 0

Note

No misconfigured workflows were detected in this window. The single opted-out workflow (Daily GitHub Docs SEO Optimizer) only had 1 run in the window, below the >3-run threshold used to flag an intentional opt-out as noteworthy, and no detection job failures or inconsistent per-run settings were observed elsewhere.

Comparison Chart

Detection-enabled runs vastly outnumber regular (opted-out) runs (313 vs 1), consistent with gh-aw-detection being enabled by default across the fleet. Detection-enabled runs show a lower success rate (80.2% vs 100.0%) and higher average token usage (163,365 vs 134,195) than the single regular run — though with n=1 for the regular group, this comparison isn't statistically meaningful this window.

Misconfigured Workflows

No misconfigured workflows detected in this window.

View All Run Metrics

Top workflows by run count in the window (114 workflows total ran at least once; showing top 20 by volume):

Workflow	Total Runs	Detection-Enabled	Regular	Success Rate	Avg Tokens	Engines
PR Sous Chef	65	65	0	100.0%	285,286	pi
Issue Monster	29	29	0	37.9%	30,716	codex, pi
Impeccable Skills Reviewer	11	11	0	100.0%	18,726	copilot
Matt Pocock Skills Reviewer	11	11	0	72.7%	36,312	copilot
PR Code Quality Reviewer	11	11	0	81.8%	1,038,316	copilot
Ponytail Reviewer	11	11	0	100.0%	113,702	codex
Design Decision Gate 🏗️	10	10	0	90.0%	208,063	pi
Test Quality Sentinel	10	10	0	100.0%	9,034	copilot
AI Moderator	8	8	0	12.5%	241,078	codex, pi
Daily Go Test Parallelizer	8	8	0	100.0%	174,288	codex
Avenger	5	5	0	40.0%	107,626	codex
Contribution Check	5	5	0	100.0%	19,117	copilot
Auto-Triage Issues	4	4	0	75.0%	416,757	codex
Code Scanning Fixer	3	3	0	0.0%	16,172	copilot
Deep Report	3	3	0	100.0%	56,465	claude
PR Triage Agent	3	3	0	100.0%	58,392	copilot
[aw] Failure Investigator (6h)	3	3	0	100.0%	9,830	claude
Daily GitHub Docs SEO Optimizer	1	0	1	100.0%	134,195	copilot
...remaining ~96 workflows	1 each	—	—	—	—	mixed

Aggregate figures:

Metric	Regular	Detection
Run count	1	313
Success rate	100.0%	80.19%
Failure count	0	62
Avg tokens	134,195	163,364.7

View Historical Trend

Across the last 8 recorded snapshots (2026-08-25 → 2026-09-09), detection-enabled run volume has held in the ~250–400/day range with success rates fluctuating 67–94%. Regular (opted-out) run volume is consistently near-zero (0–39), reflecting that almost no workflows in this repo explicitly disable detection. The one prior spike (39 regular runs on 2026-09-03, 3 misconfigured that day) has since resolved back to 0–1.

Recommendations

• No immediate action required — the fleet is overwhelmingly running with detection enabled by default, and no detection-job failures or inconsistent settings were found this window.
• Issue Monster (37.9% success, 29 runs) and AI Moderator (12.5% success, 8 runs) have unusually low success rates this window; worth a separate investigation into whether their failures are detection-related or unrelated agent/task errors (job-level data suggests these are agent-side conclusions, not detection-job failures, so out of scope for this report's misconfiguration rules).
• Continue tracking Daily GitHub Docs SEO Optimizer's gh-aw-detection: false setting — if its run frequency grows past 3 runs/window, it will trigger the opt-out flag in future reports; confirm this opt-out is intentional.

References:

• §34312080117 — example detection-enabled run (Issue Monster)
• §34312331704 — the single regular (opted-out) run (Daily GitHub Docs SEO Optimizer)

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• api.anthropic.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "api.anthropic.com"

See Network Configuration for more information.

Generated by 🔎 Detection Analysis Report · claude · agent · 161.5 AIC · ⌖ 11.5 AIC · ⊞ 9K · ◷

• expires on Sep 12, 2026, 3:39 PM UTC-08:00

[github-actions[bot]]

This discussion has been marked as outdated by Detection Analysis Report.

A newer discussion is available at Discussion #60068.