[detection-analysis] Detection Analysis Report — 2026-07-01 (last 24h)

[github-actions[bot]]

Summary

• Window evaluated: last 24 full hours (UTC), runs observed 2026-07-01T11:45Z → 13:23Z
• Total runs analyzed: 65 (runs with complete metadata)
• Detection-enabled runs: 15 (23%)
• Regular runs: 50 (77%)
• Misconfigured workflows found: 7

Warning

7 workflow(s) flagged as misconfigured in this window — see details below.

Important

Coverage caveat: the logs download hit the 60s MCP bridge timeout, so of 160 run directories fetched only 65 completed with full aw_info.json + run_summary.json metadata (the most recent ~2h). Metrics below reflect those 65 complete runs; the remaining 95 partial downloads are excluded. Detection status is read from features.gh-aw-detection per spec.

Comparison Chart

Metric	Regular Runs	Detection Runs
Total runs	50	15
Success rate (%)	76.0%	80.0%
Avg tokens (input+output)	83,460	35,500
Failure count	12	3
Misconfigured count	—	7

Detection-enabled runs show a higher success rate (80.0% vs 76.0%) and lower average token usage in this window. The token gap is largely driven by a few very heavy regular smoke-test runs (e.g. Smoke Copilot at ~1.5M tokens).

Misconfigured Workflows

Workflow	Misconfiguration type	Runs	Example	Recommended fix
Smoke CI	Detection explicitly disabled on active workflow (>3 runs/window)	6	§28515404566	Set gh-aw-detection: true — this workflow is active (>3 runs) and should have detection enabled.
Daily Agentic Workflow AIC Usage Audit	Audit/report-style workflow missing detection	1	§28517187924	Add gh-aw-detection: true — name suggests an audit/analysis/report workflow that should run detection.
GitHub MCP Structural Analysis	Audit/report-style workflow missing detection	1	§28518514050	Add gh-aw-detection: true — name suggests an audit/analysis/report workflow that should run detection.
Typist - Go Type Analysis	Audit/report-style workflow missing detection	1	§28516894278	Add gh-aw-detection: true — name suggests an audit/analysis/report workflow that should run detection.
Changeset Generator	Detection-enabled run failed (possible detection job failure)	1	§28519007285	Inspect the detection job step logs for run 28519007285; resolve the failure or errors.
Daily Max Ai Credits Test	Detection-enabled run failed (possible detection job failure)	1	§28516715137	Inspect the detection job step logs for run 28516715137; resolve the failure or errors.
Daily AIC Consumption Report (Sentry + Grafana OTel)	Detection-enabled run failed (possible detection job failure)	1	§28518314334	Inspect the detection job step logs for run 28518314334; resolve the failure or errors.

View All Run Metrics (34 workflows)

Detection column: on = gh-aw-detection: true, off = explicit false, — = absent/unset. Tokens = mean of input+output per run.

Workflow	Detection	Runs	Success	Avg tokens	Engine
Design Decision Gate 🏗️	—	6	100%	10,504	claude
Matt Pocock Skills Reviewer	—	6	83%	33,909	copilot
Test Quality Sentinel	on	6	100%	13,060	copilot
PR Code Quality Reviewer	—	6	83%	23,810	copilot
Smoke CI	off	6	0%	0	copilot
Impeccable Skills Reviewer	—	6	100%	25,439	copilot
Smoke Copilot	off	2	50%	1,496,035	copilot
Constraint Solving — Problem of the Day	on	1	100%	8,244	copilot
Daily Go Function Namer	on	1	100%	18,440	pi
AI Moderator	on	1	100%	288,211	codex
Smoke Pi	off	1	100%	7,795	pi
Auto-Triage Issues	on	1	100%	19,063	pi
Smoke Gemini	—	1	100%	0	gemini
Smoke Copilot Sub Agents	off	1	0%	0	copilot
Smoke Claude	off	1	0%	0	claude
Claude Code User Documentation Review	on	1	100%	59,535	claude
Package Specification Enforcer	—	1	100%	26,818	pi
Daily Choice Type Test	on	1	100%	6,307	claude
Smoke Antigravity	off	1	100%	0	antigravity
PR Description Updater	—	1	100%	12,237	copilot
Draft PR Cleanup	—	1	100%	2,411	copilot
Changeset Generator	on	1	0%	12,325	codex
Smoke Copilot - AOAI (apikey)	off	1	100%	152,831	copilot
Daily Agentic Workflow AIC Usage Audit	—	1	100%	16,898	copilot
Daily Max Ai Credits Test	on	1	0%	2,878	copilot
Agent Container Smoke Test	off	1	100%	4,599	copilot
Team Status	—	1	100%	11,172	copilot
PR Triage Agent	—	1	100%	12,499	copilot
Smoke Copilot - AOAI (Entra)	off	1	100%	226,940	copilot
GitHub MCP Structural Analysis	—	1	100%	34,844	claude
Smoke Codex	off	1	0%	0	codex
Daily AIC Consumption Report (Sentry + Grafana OTel)	on	1	0%	39,140	claude
Typist - Go Type Analysis	—	1	100%	41,318	claude
PR Sous Chef	—	1	100%	68,608	pi

View Historical Trend

Trend chart is generated once ≥7 days of history exist. History currently holds 5 day(s) (2026-06-27 → 2026-07-01) in the cache-memory store — building toward the threshold. Today's aggregates were appended to trending/detection-metrics/history.jsonl.

Recommendations

1. Audit/report-style workflows without detection — Daily Agentic Workflow AIC Usage Audit, GitHub MCP Structural Analysis, and Typist - Go Type Analysis have audit/analysis names but no gh-aw-detection: true. Add the flag if these are meant to run under detection.
2. Detection-enabled runs that failed — investigate Changeset Generator (codex), Daily Max Ai Credits Test (copilot), and Daily AIC Consumption Report (claude); each failed with detection on, which may indicate a detection-job or downstream error rather than a genuine task failure. Check the detection step logs.
3. Smoke CI (detection off, 6 runs, 0% success) — flagged as an active workflow with detection explicitly disabled. Smoke tests often disable detection intentionally; confirm this is deliberate and, if so, no change is needed. The 0% success rate is a separate concern worth a look.
4. Improve log-fetch completeness — the 60s bridge cap truncated the 24h download to ~2h of complete metadata. Consider narrowing start_date, paging by before_run_id, or fetching per-workflow to get full-window coverage in future runs.

References:

• §28516982620
• §28517290873

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🔎 Detection Analysis Report · 159 AIC · ⌖ 33.7 AIC · ⊞ 7.2K · ◷

• expires on Jul 4, 2026, 5:45 AM UTC-08:00

[github-actions[bot]]

This discussion has been marked as outdated by Detection Analysis Report.

A newer discussion is available at Discussion #42976.