[detection-analysis] Detection Analysis Report — 2026-07-13 (last 24h)

[github-actions[bot]]

Summary

• Window evaluated: last 24 full hours (UTC), ending 2026-07-13T13:45:00Z
• Total runs analyzed: 105
• Detection-enabled runs: 35 (33.3%)
• Regular runs (detection disabled or absent): 70 (66.7%)
• Misconfigured workflows found: 5

Warning

5 workflow(s) flagged with detection misconfigurations. See the section below.

Metric	Regular Runs	Detection Runs
Total runs	70	35
Success rate	82.9%	82.9%
Avg tokens (input+output)	85,436	137,778
Failures	12	6
Misconfigured	—	5

Read: detection-enabled and regular runs land at an identical 82.9% success rate this window, so detection adds no measurable reliability penalty. Detection runs cost ~1.6× the tokens of regular runs on average (137,778 vs 85,436), reflecting the extra detection-pass overhead.

Comparison Chart

Misconfigured Workflows

All 5 flagged workflows are audit/analysis-type workflows running without gh-aw-detection: true — the workflow name matches an audit/analysis keyword but detection is absent from its features.

Workflow	Misconfiguration	Runs	Example	Recommended fix
Typist - Go Type Analysis	Audit/analysis workflow missing gh-aw-detection: true	1	§29249325390	Add gh-aw-detection: true — audit/analysis/report/monitor workflows should run with detection enabled.
Daily Agentic Workflow AIC Usage Audit	Audit/analysis workflow missing gh-aw-detection: true	1	§29249626321	Add gh-aw-detection: true — audit/analysis/report/monitor workflows should run with detection enabled.
GitHub MCP Structural Analysis	Audit/analysis workflow missing gh-aw-detection: true	1	§29250880777	Add gh-aw-detection: true — audit/analysis/report/monitor workflows should run with detection enabled.
Copilot Agent Prompt Clustering Analysis	Audit/analysis workflow missing gh-aw-detection: true	1	§29243602880	Add gh-aw-detection: true — audit/analysis/report/monitor workflows should run with detection enabled.
Weekly Workflow Analysis	Audit/analysis workflow missing gh-aw-detection: true	1	§29242348400	Add gh-aw-detection: true — audit/analysis/report/monitor workflows should run with detection enabled.

No workflows showed inconsistent (alternating) detection state, and no active workflow (>3 runs) had detection explicitly disabled — Smoke CI runs with gh-aw-detection: false but sits at exactly 3 runs, just below the flag threshold, so it is surfaced in Recommendations rather than flagged.

View All Run Metrics (70 workflows)

Workflow	Detection	Runs	Success	Avg tokens	Engine
Design Decision Gate 🏗️	Absent	6	100.0%	11,407	claude
Impeccable Skills Reviewer	Absent	6	100.0%	6,099	copilot
Matt Pocock Skills Reviewer	Absent	6	100.0%	10,284	copilot
PR Code Quality Reviewer	Absent	6	83.3%	17,569	copilot
PR Sous Chef	Absent	6	16.7%	37,790	pi
Test Quality Sentinel	Enabled	6	100.0%	8,653	copilot
Smoke CI	Disabled	3	0.0%	0	copilot
Auto-Triage Issues	Enabled	2	50.0%	10,518	pi
PR Description Updater	Absent	2	100.0%	9,454	copilot
PR Triage Agent	Absent	2	50.0%	33,982	copilot
1. List all Go packages with their doc comments	Enabled	1	100.0%	7,119	copilot
AI Moderator	Enabled	1	100.0%	39,430	codex
Agent Container Smoke Test	Disabled	1	100.0%	4,136	copilot
Avenger	Enabled	1	100.0%	12,776	claude
Changeset Generator	Enabled	1	0.0%	0	codex
Claude Code User Documentation Review	Enabled	1	0.0%	95,681	claude
Code Scanning Fixer	Enabled	1	100.0%	5,361	copilot
Constraint Solving — Problem of the Day	Enabled	1	100.0%	7,278	copilot
Contribution Check	Enabled	1	100.0%	174,166	copilot
Copilot Agent Prompt Clustering Analysis	Absent	1	100.0%	33,155	claude
Copilot PR Conversation NLP Analysis	Enabled	1	0.0%	91,438	copilot
Copilot Session Insights	Enabled	1	100.0%	50,116	claude
Daily AIC Consumption Report (Sentry + Grafana OTel)	Enabled	1	100.0%	33,372	claude
Daily AW Cross-Repo Compile Check	Enabled	1	100.0%	39,813	claude
Daily AgentRx Trace Optimizer	Enabled	1	100.0%	49,491	claude
Daily Agentic Workflow AIC Usage Audit	Absent	1	100.0%	10,597	copilot
Daily Choice Type Test	Enabled	1	100.0%	6,668	claude
Daily Documentation Updater	Enabled	1	100.0%	76,501	pi
Daily Elixir Credo Snippet Audit	Enabled	1	100.0%	10,440	claude
Daily Go Function Namer	Enabled	1	100.0%	15,390	pi
Daily Hippo Learn	Enabled	1	100.0%	113,522	pi
Daily MCP Tool Concurrency Analysis	Enabled	1	100.0%	10,811	copilot
Daily Max Ai Credits Test	Enabled	1	0.0%	2,851	copilot
Daily News	Enabled	1	100.0%	45,593	pi
Daily Rendering Scripts Verifier	Enabled	1	100.0%	27,191	claude
Daily Safe Outputs Conformance Checker	Absent	1	100.0%	13,465	claude
Daily Sub-Agent Model Resolution Audit	Enabled	1	100.0%	3,478,842	copilot
Daily Syntax Error Quality Check	Absent	1	100.0%	7,593	copilot
Daily Workflow Updater	Absent	1	100.0%	4,281	copilot
Dependabot Dependency Checker	Absent	1	100.0%	15,493	copilot
Dev	Absent	1	100.0%	518,235	codex
Draft PR Cleanup	Absent	1	100.0%	5,735	copilot
ESLint Miner	Absent	1	100.0%	23,614	copilot
GitHub API Consumption Report Agent	Enabled	1	100.0%	42,493	claude
GitHub MCP Structural Analysis	Absent	1	100.0%	31,204	claude
Glossary Maintainer	Absent	1	100.0%	15,822	copilot
Go Fan	Absent	1	100.0%	29,463	claude
Instructions Janitor	Absent	1	100.0%	28,949	claude
Issue Monster	Absent	1	100.0%	13,636	pi
Layout Specification Maintainer	Absent	1	0.0%	14,453	copilot
Multi-Device Docs Tester	Enabled	1	100.0%	23,742	pi
Package Specification Enforcer	Absent	1	100.0%	31,091	pi
Package Specification Extractor	Absent	1	100.0%	9,564	copilot
Schema Feature Coverage Checker	Absent	1	100.0%	39,802	codex
Smoke Antigravity	Disabled	1	100.0%	0	antigravity
Smoke Claude	Disabled	1	100.0%	22,910	claude
Smoke Codex	Disabled	1	100.0%	420,673	codex
Smoke Copilot	Disabled	1	0.0%	2,092,268	copilot
Smoke Copilot - AOAI (Entra)	Disabled	1	100.0%	110,168	copilot
Smoke Copilot - AOAI (apikey)	Disabled	1	100.0%	996,292	copilot
Smoke Copilot Small	Disabled	1	100.0%	3,204	copilot
Smoke Gemini	Absent	1	100.0%	122,531	gemini
Smoke Pi	Disabled	1	100.0%	8,811	pi
Sub-Issue Closer	Absent	1	100.0%	5,508	copilot
Team Status	Absent	1	100.0%	43,992	copilot
Terminal Stylist	Absent	1	100.0%	33,316	copilot
Typist - Go Type Analysis	Absent	1	100.0%	76,031	claude
Weekly Workflow Analysis	Absent	1	100.0%	28,804	claude
[aw] Failure Investigator (6h)	Enabled	1	100.0%	19,990	claude
daily-experiment-report	Enabled	1	0.0%	131,441	copilot

Detection column: Enabled = gh-aw-detection: true; Disabled = explicitly false; Absent = feature not set; Mixed = both within the window. Avg tokens = input+output; 0 means no usage artifact was recorded for that run.

View Historical Trend (17 days)

Detection-run volume has trended upward over the window (from single digits in late June to 35 runs today), while detection success rate has stayed in the 80–95% band apart from a 2026-07-09 dip.

Recommendations

1. Enable detection on the 5 audit/analysis workflows above. Add gh-aw-detection: true to each workflow's frontmatter — these are exactly the workflows where detection provides the most value.
2. Review Smoke CI (3 runs, gh-aw-detection: false, 0% success). It is one run below the active-workflow threshold and is currently failing every run; confirm whether detection should be enabled and why it is failing.
3. Investigate the 6 detection-enabled failures (e.g. Changeset Generator, Claude Code User Documentation Review, Copilot PR Conversation NLP Analysis, daily-experiment-report). This report used only usage artifacts; re-run with --artifacts agent to confirm whether any failure originated in the detection job step itself (misconfiguration rule 3) rather than the agent body.
4. Watch token cost on detection runs. Detection runs average ~1.6× the tokens of regular runs; keep this in mind as detection adoption grows.

Caveats: Misconfiguration rule 1 (detection disabled on workflows with >3 runs over 7 days) was evaluated against the 24h window as a proxy — a full 7-day pull would refine it. Rule 3 (detection-job failures) could not be confirmed because only usage artifacts were downloaded.

References:

• §29252659931
• §29229887419

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🔎 Detection Analysis Report · 217 AIC · ⌖ 38.8 AIC · ⊞ 7.1K · ◷

• expires on Jul 16, 2026, 5:49 AM UTC-08:00

[github-actions[bot]]

This discussion has been marked as outdated by Detection Analysis Report.

A newer discussion is available at Discussion #45488.