[detection-analysis] Detection Analysis Report — 2026-07-14 (last 24h)

[github-actions[bot]]

Summary

• Window evaluated: last 24 full hours (UTC) — 2026-07-13T13:12:41Z → 2026-07-14T13:12:41Z
• Total runs analyzed: 103
• Detection-enabled runs: 29 (28.2%)
• Regular runs: 74 (71.8%)
• Misconfigured workflows found: 5

Warning

5 workflows show detection misconfigurations in this window. See the Misconfigured Workflows section for recommended fixes.

Detection-enabled runs outperformed regular runs on reliability this window (93.1% vs 82.4% success) at a comparable token cost (~38.8k vs ~36.5k tokens/run). Note the regular-run success rate is depressed almost entirely by Smoke CI (9/9 failures, 0 agent tokens — a non-agent CI smoke test); excluding it, regular agent runs succeeded at ~93.8% (61/65).

Comparison Chart

Metric	Regular Runs	Detection Runs
Total runs	74	29
Success rate (%)	82.4%	93.1%
Avg tokens	36,472	38,786
Failure count	13	2
Misconfigured count	—	5

(a name="misconfigured-workflows")(/a)

Misconfigured Workflows

Workflow	Misconfiguration type	Run count	Recommended fix
Smoke CI	Detection explicitly disabled on active workflow (>3 runs)	9	Remove gh-aw-detection: false or set true; workflow is active (9 runs) and should be monitored. Also investigate the 9/9 failure streak.
Copilot Agent Prompt Clustering Analysis	Audit/analysis workflow missing gh-aw-detection: true	1	Add gh-aw-detection: true — analysis workflows should have detection enabled.
Daily Agentic Workflow AIC Usage Audit	Audit/analysis workflow missing gh-aw-detection: true	1	Add gh-aw-detection: true — audit workflows should have detection enabled.
GitHub MCP Structural Analysis	Audit/analysis workflow missing gh-aw-detection: true	1	Add gh-aw-detection: true — analysis workflows should have detection enabled.
Typist - Go Type Analysis	Audit/analysis workflow missing gh-aw-detection: true	1	Add gh-aw-detection: true — analysis workflows should have detection enabled.

No detection-job step failures (Rule 3) and no intra-window detection state flips (Rule 4) were detected. The 2 detection-enabled failures (Copilot PR Conversation NLP Analysis, Daily Max Ai Credits Test) were general workflow failures, not detection-step failures.

View All Run Metrics (45 workflows)

Workflow	Detection	Runs	Success	Avg tokens
Smoke CI	off	9	0/9 (0%)	0
Tidy	absent	8	8/8 (100%)	5,277
Auto-Triage Issues	on	7	7/7 (100%)	6,662
PR Description Updater	absent	7	7/7 (100%)	9,953
PR Sous Chef	absent	7	7/7 (100%)	26,514
Design Decision Gate 🏗️	absent	5	5/5 (100%)	9,811
Impeccable Skills Reviewer	absent	5	5/5 (100%)	6,098
Matt Pocock Skills Reviewer	absent	5	5/5 (100%)	10,484
PR Code Quality Reviewer	absent	5	4/5 (80%)	19,324
Test Quality Sentinel	on	5	5/5 (100%)	14,248
Issue Monster	absent	4	4/4 (100%)	14,599
AI Moderator	on	2	2/2 (100%)	203,984
Sighthound Security Scan	absent	2	2/2 (100%)	8,760
Agent Performance Analyzer - Meta-Orchestrator	on	1	1/1 (100%)	15,115
Claude Code User Documentation Review	on	1	1/1 (100%)	94,795
Constraint Solving — Problem of the Day	on	1	1/1 (100%)	8,486
Contribution Check	on	1	1/1 (100%)	32,790
Copilot Agent Prompt Clustering Analysis	absent	1	1/1 (100%)	31,154
Copilot PR Conversation NLP Analysis	on	1	0/1 (0%)	88,404
Daily AIC Consumption Report (Sentry + Grafana OTel)	on	1	1/1 (100%)	33,493
Daily AW Cross-Repo Compile Check	on	1	1/1 (100%)	112,822
Daily Agentic Workflow AIC Usage Audit	absent	1	1/1 (100%)	10,593
Daily Choice Type Test	on	1	1/1 (100%)	6,971
Daily Documentation Updater	on	1	1/1 (100%)	58,832
Daily File Diet	on	1	1/1 (100%)	14,787
Daily Go Function Namer	on	1	1/1 (100%)	12,833
Daily MCP Tool Concurrency Analysis	on	1	1/1 (100%)	10,558
Daily Max Ai Credits Test	on	1	0/1 (0%)	2,851
Daily News	on	1	1/1 (100%)	58,765
Dev	absent	1	1/1 (100%)	1,090,708
Draft PR Cleanup	absent	1	1/1 (100%)	5,560
ESLint Miner	absent	1	1/1 (100%)	41,620
Functional Pragmatist	absent	1	1/1 (100%)	11,399
GitHub API Consumption Report Agent	on	1	1/1 (100%)	47,445
GitHub MCP Structural Analysis	absent	1	1/1 (100%)	30,028
Glossary Maintainer	absent	1	1/1 (100%)	16,465
Instructions Janitor	absent	1	1/1 (100%)	105,193
PR Triage Agent	absent	1	0/1 (0%)	74,196
Package Specification Enforcer	absent	1	1/1 (100%)	30,038
Package Specification Extractor	absent	1	1/1 (100%)	19,494
Smoke Crush	off	1	0/1 (0%)	0
Smoke OpenCode	off	1	1/1 (100%)	8,152
Team Status	absent	1	1/1 (100%)	34,682
Terminal Stylist	absent	1	1/1 (100%)	92,916
Typist - Go Type Analysis	absent	1	0/1 (0%)	98,826

Detection column: on = gh-aw-detection: true, off = explicitly false, absent = flag unset, mixed = varies within window.

View Historical Trend

18 days of history available (2026-06-27 → 2026-07-14). Detection adoption has stabilized at ~28–35 runs/day with the detection success-rate band holding in the 80–95% range.

Recommendations

1. Smoke CI — highest priority. It carries an explicit gh-aw-detection: false on an active (9-run) workflow and is failing every run (9/9, 0 tokens). Re-enable detection and triage the failing smoke test; it is the single largest driver of the regular-run failure count.
2. Enable detection on the four audit/analysis workflows (Copilot Agent Prompt Clustering Analysis, Daily Agentic Workflow AIC Usage Audit, GitHub MCP Structural Analysis, Typist - Go Type Analysis) by adding gh-aw-detection: true to their frontmatter — analysis/audit workflows benefit most from run-behavior detection.
3. Adoption is healthy (28.2% of runs, 93.1% success) — continue rolling detection out to the remaining absent workflows, prioritizing high-token ones (e.g. Dev, Instructions Janitor, Terminal Stylist) where behavior monitoring adds the most value.

References:

• §29335103704
• §29319570721 (Smoke CI example)
• §29324162906

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🔎 Detection Analysis Report · 176.1 AIC · ⌖ 23.8 AIC · ⊞ 7.1K · ◷

• expires on Jul 17, 2026, 5:22 AM UTC-08:00