[detection-analysis] Detection Analysis Report — 2026-09-11

[github-actions[bot]]

Summary

• Window evaluated: last 24 full hours (UTC), 2026-09-10T23:36Z → 2026-09-11T23:36Z
• Total runs analyzed (full telemetry): 442
• Detection-enabled runs: 430 (97.3%)
• Regular runs (gh-aw-detection: false): 12 (2.7%)
• Misconfigured workflows found: 0

Note

No misconfigured gh-aw-detection workflows were found in this window. All 12 explicit opt-outs are single-run smoke-test workflows well under the >3-runs threshold for flagging, and no detection job showed a failing conclusion.

Comparison Chart

Regular runs had a 50.0% success rate vs. 51.2% for detection-enabled runs — no meaningful difference in reliability between the two groups this window. Average token usage reported as 0 for both groups — see caveat below.

Misconfigured Workflows

No misconfigured workflows detected in this window.

View All Run Metrics

Top workflows by run count (177 distinct workflows total in window):

Workflow	Total Runs	Detection	Regular	Success Rate	Engine
PR Sous Chef	75	75	0	45.3%	pi
Issue Monster	44	44	0	0.0%	pi
Matt Pocock Skills Reviewer	16	16	0	68.8%	copilot
[aw] Failure Investigator (6h)	16	16	0	18.8%	claude
Ponytail Reviewer	15	15	0	100.0%	codex
Design Decision Gate 🏗️	15	15	0	93.3%	pi
Impeccable Skills Reviewer	15	15	0	20.0%	copilot
PR Code Quality Reviewer	15	15	0	0.0%	copilot
Test Quality Sentinel	14	14	0	92.9%	copilot
AI Moderator	14	14	0	0.0%	pi
Daily Go Test Parallelizer	11	11	0	36.4%	codex
Auto-Triage Issues	8	8	0	37.5%	codex
Avenger	7	7	0	42.9%	codex
Contribution Check	5	5	0	40.0%	copilot
Release	4	4	0	75.0%	copilot

Explicit gh-aw-detection: false opt-outs seen this window (all single-run, below the flagging threshold): Agent Container Smoke Test, Smoke Pi, Smoke Codex, Smoke Copilot Auto, Smoke Claude, Smoke Copilot, Smoke Copilot - AOAI (apikey), Smoke Copilot - AOAI (Entra), Smoke Copilot MAI, Smoke Copilot Small, Smoke OTEL, Daily GitHub Docs SEO Optimizer.

Data caveat: 165 additional runs in the window (mostly non-agentic CI jobs and a few agentic runs, e.g. AI Moderator dependabot triggers) had only a raw run.json — no aw_info.json/run_summary.json — so they could not be classified by detection status and are excluded from the totals above.

Token usage caveat: TokenUsage reads as 0 for every one of the 442 runs in this window, for both groups. Historical trend entries from prior days show non-zero averages (tens of thousands to ~250K tokens/run), so this looks like a telemetry gap in today's log batch rather than a real drop in usage — worth a follow-up check on the metrics pipeline rather than treating it as a detection-feature effect.

View Historical Trend

Detection-run volume has grown from ~250/day to ~430/day over the last ~2.5 weeks, while regular (opted-out) runs have stayed near-zero throughout. Detection success rate has ranged roughly 60–93% day to day.

Recommendations

1. No configuration fixes needed this window — the gh-aw-detection feature is being used as intended (default-on, with a small, appropriately-scoped set of smoke-test opt-outs).
2. Investigate why TokenUsage is reporting 0 across all 442 runs today — compare against the log-collection/metrics pipeline that populates run_summary.json's run.TokenUsage field, since prior days show real non-zero values.
3. Consider extending log retention/collection so the 165 runs missing aw_info.json/run_summary.json (mostly non-lock-file CI jobs, but including at least one agentic run) can be classified in future reports.

References:

• §34552262956 — PR Sous Chef, highest-volume detection-enabled workflow this window
• §34563380652 — Smoke Copilot, example of an intentional gh-aw-detection: false opt-out

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• api.anthropic.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "api.anthropic.com"

See Network Configuration for more information.

Generated by 🔎 Detection Analysis Report · claude · agent · 201.3 AIC · ⌖ 8.84 AIC · ⊞ 9K · ◷

• expires on Sep 14, 2026, 3:43 PM UTC-08:00

[github-actions[bot]]

This discussion has been marked as outdated by Detection Analysis Report.

A newer discussion is available at Discussion #60483.