[detection-analysis] Detection Analysis Report — 2026-10-31

[github-actions[bot]]

Summary

• Window evaluated: last 24 full hours (UTC), 2026-10-30T23:13:51Z → 2026-10-31T23:13:51Z
• Total runs analyzed: 549 (with full detection-status data), out of 740 downloaded run directories — 191 runs were metadata-only (missing aw_info.json/run_summary.json, likely truncated by the storage budget) and are excluded from classification; coverage for those is unknown
• Detection-enabled runs: 495 (90.2%)
• Regular runs (gh-aw-detection: false): 54 (9.8%)
• Misconfigured workflows found: 0

Note

No detection-related misconfigurations were detected in this window. All workflows explicitly disabling detection had ≤3 runs in this 24h window (rule 1 threshold not met), no run showed the detection job itself failing while detection was enabled (rule 2), and no workflow toggled the flag mid-window (rule 3).

Comparison Chart

Metric	Regular Runs	Detection Runs
Run count	54	495
Success rate	75.93%	66.67%
Failure count	13	165
Avg. token usage	110,556	222,682

Detection-enabled runs show a lower success rate and roughly 2x the average token usage compared to regular runs. This is directionally expected since detection adds a dedicated job/step (and most production workflows use detection by default), but the gap is worth tracking over time via the trend chart below.

Misconfigured Workflows

No misconfigured workflows detected in this window.

View All Run Metrics

203 workflows observed. "Detection" = all runs had detection enabled (default or explicit true); "Regular" = all runs had gh-aw-detection: false; "Mixed" = alternated (none observed this window).

Workflow	Detection Status	Runs	Success Rate	Avg Tokens
PR Sous Chef	Detection	130	1.5%	5,268
Issue Monster	Detection	46	97.8%	76,617
Matt Pocock Skills Reviewer	Detection	24	100.0%	31,080
Test Quality Sentinel	Detection	24	100.0%	9,812
Ponytail Reviewer	Detection	23	100.0%	145,110
Design Decision Gate 🏗️	Detection	22	100.0%	157,346
PR Code Quality Reviewer	Detection	22	100.0%	16,744
Avenger	Detection	18	100.0%	1,510,069
Daily Go Test Parallelizer	Detection	12	100.0%	1,371,771
AI Moderator	Detection	9	100.0%	937
Auto-Triage Issues	Detection	6	100.0%	148,367
Contribution Check	Detection	6	100.0%	18,935
[aw] Failure Investigator (6h)	Detection	5	100.0%	471
Code Scanning Fixer	Detection	4	100.0%	11,599
PR Triage Agent	Detection	4	100.0%	65,116
Daily Credit Limit Test	Detection	2	100.0%	47,152
Daily Go Function Namer	Detection	2	100.0%	307,225
Front Page Copy Guard	Detection	2	100.0%	63,448
Impeccable Skills Reviewer	Detection	2	100.0%	25,244
Terminal Stylist	Detection	2	100.0%	8,301,216
Visual Regression Checker	Detection	2	0.0%	18,934
AW Essential Issue Clustering	Detection	1	100.0%	15,239
Actions and AW Linter Factory	Detection	1	100.0%	78,389
Agent Container Smoke Test	Regular	1	100.0%	130,168
Agent Job Health Monitor	Detection	1	0.0%	0
Agent Performance Analyzer - Meta-Orchestrator	Detection	1	100.0%	17,840
Agent Persona Explorer	Detection	1	100.0%	21,477
Agentic Workflow Audit Agent	Detection	1	0.0%	61,967
CLI Version Checker	Detection	1	100.0%	1,089,835
Cache directory setup	Detection	1	0.0%	222,975
Claude Code User Documentation Review	Detection	1	100.0%	82,305
Code Simplifier	Detection	1	100.0%	8,209
Constraint Solving — Problem of the Day	Detection	1	100.0%	11,657
Copilot Agent PR Analysis	Detection	1	100.0%	18,541
Copilot Agent Prompt Clustering Analysis	Detection	1	0.0%	337
Copilot CLI Deep Research Agent	Detection	1	100.0%	13,080
Copilot PR Prompt Pattern Analysis	Detection	1	100.0%	12,978
Copilot Session Insights	Detection	1	100.0%	74,899
Daily A/B Testing Advisor	Detection	1	0.0%	0
Daily AWF Spec Compiler Surfacing Review	Detection	1	0.0%	55,491
Daily Ambient Context Optimizer	Detection	1	100.0%	19,381
Daily Assign Issue To User	Detection	1	100.0%	8,635
Daily AstroStyleLite Markdown Spellcheck	Detection	1	100.0%	11,714
Daily CLI Performance Agent	Detection	1	100.0%	662,496
Daily Cache Strategy Analyzer	Detection	1	100.0%	4,176,620
Daily Caveman Optimizer	Detection	1	0.0%	595
Daily Cli Tools Tester	Detection	1	0.0%	983,026
Daily Code Debt Cleanup — Aider	Detection	1	0.0%	28,248
Daily Code Metrics and Trend Tracking Agent	Detection	1	100.0%	19,181
Daily Community Attribution Updater	Detection	1	100.0%	15,269
Daily Compiler Threat Spec Optimizer	Detection	1	100.0%	9,229
Daily Container Image Security Scan	Detection	1	100.0%	26,335
Daily Discussion Report Dispatcher	Detection	1	100.0%	7,146
Daily Documentation Diagram	Detection	1	100.0%	646,897
Daily Documentation Healer	Detection	1	100.0%	26,359
Daily Documentation Updater	Detection	1	100.0%	1,837,026
Daily Ecosystem Explorer	Detection	1	100.0%	10,163
Daily Formal Spec Verifier	Detection	1	0.0%	12,272
Daily GitHub Docs SEO Optimizer	Regular	1	100.0%	10,088
Daily Grader Audit	Detection	1	100.0%	13,851
Daily Graft Intelligence	Detection	1	100.0%	7,059
Daily Harness Experiment Proposer	Detection	1	100.0%	23,020
Daily Malicious Code Scan Agent	Detection	1	100.0%	10,958
Daily Max Ai Credits Test	Detection	1	0.0%	139,603
Daily Model Inventory Checker	Detection	1	100.0%	16,673
Daily PR Code Quality Review	Detection	1	0.0%	1,753
Daily Project Performance Summary Generator (Using MCP Scripts)	Detection	1	100.0%	382,510
Daily Regression Audit	Detection	1	100.0%	4,406
Daily Rendering Scripts Verifier	Detection	1	100.0%	5,427
Daily SPDD Spec Planner	Detection	1	100.0%	11,968
Daily Safe Output Integrator	Detection	1	100.0%	8,573
Daily Safe Output Tool Optimizer	Detection	1	100.0%	60,943
Daily Safe Outputs Conformance Checker	Detection	1	100.0%	788
Daily Safe Outputs Git Simulator	Detection	1	100.0%	2,815
Daily Schema Consistency Audit	Detection	1	0.0%	925
Daily Security Observability Report	Detection	1	100.0%	20,222
Daily Spec Coverage Review	Detection	1	0.0%	1,087
Daily Spending Forecast	Detection	1	100.0%	431,214
Daily Storify	Detection	1	100.0%	1,533,817
Daily Sub-Agent Model Resolution Audit	Detection	1	100.0%	41,534
Daily Syntax Error Quality Check	Detection	1	100.0%	10,567
Daily VulnHunter Scan	Detection	1	100.0%	9,751
Daily Windows Defender Release Scan	Detection	1	100.0%	0
Daily Windows Terminal Integration Builder	Detection	1	100.0%	179,883
Daily Work Queue Formal Verification	Detection	1	0.0%	0
Daily Work Queues Report	Detection	1	100.0%	11,665
Daily Workflow Security Model	Detection	1	0.0%	19,158
Daily Workflow Updater	Detection	1	100.0%	8,442
Daily action/setup/* Security Audit	Detection	1	100.0%	11,158
Dead Code Removal Agent	Detection	1	100.0%	15,319
Delight	Detection	1	100.0%	12,714
Detection Analysis Report	Detection	1	0.0%	0
Developer Documentation Consolidator	Detection	1	100.0%	146,803
Documentation Noob Tester	Detection	1	100.0%	11,534
Documentation Unbloat	Detection	1	100.0%	2,443
Draft PR Cleanup	Detection	1	100.0%	754
Duplicate Code Detector	Detection	1	0.0%	4,337,997
ESLint Factory Dispatcher	Detection	1	100.0%	7,382
Engine Conformance Dispatcher	Detection	1	0.0%	6,863
GPL Dependency Cleaner (gpclean)	Detection	1	100.0%	386,152
GitHub API Consumption Report Agent	Detection	1	100.0%	346,663
GitHub Remote MCP Authentication Test	Detection	1	100.0%	92,629
Go Logger Enhancement	Detection	1	100.0%	4,128
Instructions Janitor	Detection	1	100.0%	28,712
Issue Arborist	Detection	1	100.0%	204,333
LintMonster	Detection	1	0.0%	1,679,597
Linter Miner	Detection	1	100.0%	15,109
Lockfile Statistics Analysis Agent	Detection	1	100.0%	6,400
Metrics Collector	Detection	1	100.0%	2,592,719
Multi-Device Docs Tester	Detection	1	100.0%	222,428
Package Specification Enforcer	Detection	1	0.0%	0
Package Specification Extractor	Detection	1	100.0%	10,998
Package Specification Librarian	Detection	1	100.0%	9,784
PureLock	Detection	1	0.0%	7,007,374
Safe Output Health Monitor	Detection	1	0.0%	71,197
Schema Consistency Checker	Detection	1	100.0%	333,102
Semantic Function Refactoring	Detection	1	100.0%	6,871
Sergo - Serena Go Expert	Detection	1	100.0%	58,355
Smoke Agent: all/merged	Regular	1	100.0%	2,220
Smoke Agent: all/none	Regular	1	100.0%	1,841
Smoke Agent: public/approved	Regular	1	100.0%	3,434
Smoke Agent: public/none	Regular	1	100.0%	1,903
Smoke Agent: scoped/approved	Regular	1	100.0%	3,378
Smoke Aider	Regular	1	100.0%	18,069
Smoke Azure Codex	Detection	1	0.0%	0
Smoke Azure PI	Detection	1	0.0%	0
Smoke Built-in Ledgers	Regular	1	100.0%	555,797
Smoke Call Workflow	Regular	1	100.0%	35,768
Smoke Checkout PR Dispatch	Regular	1	100.0%	1,079
Smoke Claude	Regular	1	100.0%	17,658
Smoke Claude Auto	Detection	1	100.0%	214
Smoke Claude Copilot Auto	Detection	1	100.0%	224
Smoke Claude Routed	Regular	1	100.0%	1,832
Smoke Claude Routed Anthropic	Regular	1	100.0%	1,888
Smoke Claude on Copilot	Detection	1	100.0%	464
Smoke Codex	Regular	1	100.0%	492,071
Smoke Codex Auto	Detection	1	100.0%	28,589
Smoke Codex Bare Auto	Detection	1	100.0%	29,034
Smoke Codex Routed	Regular	1	100.0%	58,868
Smoke Codex Routed OpenAI	Regular	1	100.0%	29,549
Smoke Copilot	Regular	1	100.0%	2,828
Smoke Copilot - AOAI (Entra)	Regular	1	0.0%	0
Smoke Copilot - AOAI (apikey)	Regular	1	0.0%	580,301
Smoke Copilot ARM64	Regular	1	100.0%	12,161
Smoke Copilot Auto	Regular	1	100.0%	4,061
Smoke Copilot MAI	Regular	1	100.0%	63,450
Smoke Copilot Routed	Detection	1	100.0%	80,456
Smoke Copilot Routed Claude	Regular	1	100.0%	2,314
Smoke Copilot Routed Steering	Regular	1	100.0%	2,292,288
Smoke Copilot SDK	Regular	1	100.0%	1,528
Smoke Copilot SDK Routed	Regular	1	100.0%	4,441
Smoke Copilot SDK Routed Claude	Regular	1	100.0%	2,304
Smoke Copilot Small	Regular	1	100.0%	1,769
Smoke Copilot Sub Agents	Regular	1	100.0%	22,678
Smoke Create Cross-Repo PR	Regular	1	0.0%	2,563
Smoke Crush	Regular	1	100.0%	111,691
Smoke Cursor	Regular	1	100.0%	0
Smoke DeepSeek Harness	Regular	1	0.0%	199,177
Smoke Drive	Regular	1	0.0%	29,351
Smoke Gemini	Detection	1	0.0%	0
Smoke GitHub Claude	Detection	1	100.0%	493
Smoke Goose	Regular	1	0.0%	8,561
Smoke Issues	Detection	1	100.0%	1,625
Smoke Kiro	Regular	1	100.0%	0
Smoke Multi PR	Regular	1	100.0%	8,516
Smoke OTEL	Regular	1	100.0%	341,089
Smoke OpenCode	Regular	1	100.0%	26,586
Smoke Pi	Regular	1	0.0%	56,851
Smoke Pi Auto	Detection	1	100.0%	8,486
Smoke Pi Routed	Regular	1	100.0%	61,289
Smoke Pi Routed Claude	Regular	1	100.0%	1,890
Smoke Project	Regular	1	0.0%	1,448
Smoke Pydantic AI	Regular	1	0.0%	341,980
Smoke Repo-Memory Ledger	Regular	1	100.0%	165,161
Smoke Service Ports	Regular	1	100.0%	117,179
Smoke Temporary ID	Regular	1	100.0%	81,786
Smoke Update Cross-Repo PR	Regular	1	0.0%	2,535
Smoke Work Queue	Regular	1	0.0%	32,650
Smoke Workflow Call	Regular	1	100.0%	1,502
Smoke Workflow Call with Inputs	Regular	1	100.0%	5,150
Squad Game Planner	Detection	1	100.0%	10,709
Stale PR Cleanup	Detection	1	100.0%	8,658
Static Analysis Report	Detection	1	100.0%	94,318
Step Name Alignment	Detection	1	100.0%	19,433
Sub-Issue Closer	Detection	1	100.0%	356,755
Team Status	Detection	1	100.0%	3,177
The Great Escapi	Detection	1	0.0%	10,634
Tidy	Detection	1	0.0%	9,258
Weekly Editors Health Check	Detection	1	100.0%	9,302
Weekly Network Domain Set Audit	Detection	1	100.0%	23,755
Workflow Health Manager - Meta-Orchestrator	Detection	1	100.0%	11,447
Workflow Normalizer	Detection	1	100.0%	341,312
arXiv Paper Researcher: GitHub Agentic Workflows	Detection	1	100.0%	2,908,422
daily-experiment-report	Detection	1	100.0%	19,123
gh-aw work-queue d_82d158b8cae202fcbfe6d5900454e09522dff88e14b1e292220d636cab0fe402_1	Detection	1	0.0%	12,805
gh-aw work-queue d_82d158b8cae202fcbfe6d5900454e09522dff88e14b1e292220d636cab0fe402_2	Detection	1	0.0%	212,007
gh-aw work-queue d_82d158b8cae202fcbfe6d5900454e09522dff88e14b1e292220d636cab0fe402_3	Detection	1	0.0%	14,260
gh-aw work-queue d_acec8bf5477b3328a526a1d7d6fd8d412ce0c2732926edeb2c59b4e0bd349cfa_2	Regular	1	0.0%	1,691
gh-aw work-queue d_acec8bf5477b3328a526a1d7d6fd8d412ce0c2732926edeb2c59b4e0bd349cfa_3	Regular	1	0.0%	15,644
gh-aw work-queue d_e799fa92b17275ebc25f7c2d96a88c44ceb564067d8fa194b4d0f9aba9e38a4e_1	Detection	1	0.0%	128,743
gh-aw work-queue d_e799fa92b17275ebc25f7c2d96a88c44ceb564067d8fa194b4d0f9aba9e38a4e_2	Detection	1	0.0%	18,829
gh-aw work-queue d_e799fa92b17275ebc25f7c2d96a88c44ceb564067d8fa194b4d0f9aba9e38a4e_3	Detection	1	0.0%	129,010
jsweep - JavaScript Unbloater	Detection	1	100.0%	13,385

View Historical Trend

Trending history now holds 32 distinct days (2026-08-23 → 2026-10-31, with some gaps) in /tmp/gh-aw/cache-memory/trending/detection-metrics/history.jsonl. Today's data point was appended.

Recommendations

1. No detection-configuration action needed this window — no workflow met the misconfiguration thresholds for rule 1 (persistent gh-aw-detection: false), rule 2 (detection job itself failing), or rule 3 (flag toggling mid-window).
2. Investigate "PR Sous Chef" separately (not a detection issue): 130/130 runs this window had the agent job succeed and 129/130 had the detection job succeed, yet the overall run conclusion was failure in 127/130 cases. The failure is attributable to a later job (e.g. safe_outputs) in at least one sampled run, not to detection — worth a dedicated investigation outside this report's scope.
3. Close the 191-run metadata gap: 191 of 740 downloaded run directories lacked aw_info.json/run_summary.json (likely truncated by the storage budget) and were excluded from detection classification. If a future run needs tighter precision on the detection/regular split, increase the log-collection storage budget or target a narrower time window to avoid gaps.
4. Token usage gap: detection-enabled runs averaged ~2x the tokens of regular runs (222,682 vs 110,556). This is expected overhead from the dedicated detection job, but is worth periodic monitoring via the trend chart as the fleet of detection-enabled workflows grows.

Generated by 🔎 Detection Analysis Report · claude · agent · ~117 AIC · ⌖ ~1 AIC · ⊞ 4.4K · ◷

• expires on Nov 3, 2026, 3:30 PM UTC-08:00

[github-actions[bot]]

This discussion has been marked as outdated by Detection Analysis Report.

A newer discussion is available at Discussion #73906.