[detection-analysis] Detection Analysis Report — 2026-11-08

[github-actions[bot]]

Summary

• Window evaluated: last 24 full hours (UTC), nominally 2026-11-07T23:14Z → 2026-11-08T23:14Z
• Coverage note: log collection hit a GitHub API rate limit (403 on actions/workflows) partway through the continuation fetch, and storage usage reached ~983 MB of the 1 GB budget. Actual data analyzed spans 2026-11-08T03:18Z → 2026-11-08T23:12Z (~20 of the 24 hours) — the earliest ~4 hours of the window (2026-11-07T23:14Z–2026-11-08T03:18Z) were not collected. Figures below reflect this partial-but-majority sample, not the full 24h window.
• Total runs analyzed (classified): 602 across 129 workflows (plus 310 additional downloaded run directories excluded from classification because they had no aw_info.json — i.e. the agent job never executed, consistent with activation/admission-skip or non-agentic jobs)
• Detection-enabled runs: 601 (99.8%)
• Regular runs (gh-aw-detection: false): 1 (0.2%)
• Misconfigured workflows found: 6 (all one underlying root cause — see below)

Warning

6 workflows show a failing detection job, but all 6 failures cluster in a ~3-hour window (08:44–11:55 UTC on 2026-11-08) and share the identical failing step — "Install AWF binary" — which also failed in the agent job for half of them. This points to a shared, transient infrastructure issue (e.g. a binary release/CDN hiccup) rather than 6 independent per-workflow detection misconfigurations.

Comparison Chart

Note: the "Regular Runs" group has only 1 run in this window (gh-aw-detection: false is rare — only one workflow, Daily GitHub Docs SEO Optimizer, opted out, and it ran once), so the regular-vs-detection comparison is based on an extremely small regular-run sample this period.

Misconfigured Workflows

Workflow	Misconfiguration Type	Run Count	Recommended Fix
PR Sous Chef	detection job step failure (Install AWF binary)	1	Investigate transient AWF binary install failure — see shared root cause below
Engine Conformance Dispatcher	detection job step failure (Install AWF binary) — agent job also failed on same step	1	Investigate transient AWF binary install failure — see shared root cause below
Copilot Agent Prompt Clustering Analysis	detection job step failure (Install AWF binary)	1	Investigate transient AWF binary install failure — see shared root cause below
Daily A/B Testing Advisor	detection job step failure (Install AWF binary)	1	Investigate transient AWF binary install failure — see shared root cause below
Daily Go Function Namer	detection job step failure (Install AWF binary) — agent job also failed on same step	1	Investigate transient AWF binary install failure — see shared root cause below
Smoke Issues	detection job step failure (Install AWF binary) — agent job also failed on same step	1	Investigate transient AWF binary install failure — see shared root cause below

Recommended next step: Rather than per-workflow fixes, investigate whether the AWF binary download source (release artifact/CDN) had an outage between 08:44–11:55 UTC on 2026-11-08. All 6 occurrences are single, isolated runs for their respective workflows (no workflow shows a sustained or repeated pattern), so no gh-aw-detection frontmatter change is indicated for any of them. No workflow in this window matched the "detection explicitly disabled on a frequently-run workflow" rule (only 1 regular run total, for Daily GitHub Docs SEO Optimizer, well under the >3-runs threshold) or the "flag alternates within window" rule.

View All Run Metrics

Full per-workflow breakdown (129 workflows, 602 classified runs):

Workflow	Total Runs	Detection	Regular	Success %	Avg Tokens
PR Sous Chef	112	112	0	94.6%	1,344
PR Code Quality Reviewer	52	52	0	96.2%	14,458
Test Quality Sentinel	52	52	0	98.1%	91,752
Design Decision Gate 🏗️	51	51	0	82.4%	54,432
Ponytail Reviewer	51	51	0	98.0%	385,834
PR Specification Reviewer	49	49	0	85.7%	2,516
Matt Pocock Skills Reviewer	47	47	0	95.7%	74,735
Auditor	20	20	0	0.0%	0
Auto-Triage Issues	13	13	0	100.0%	238,095
Daily Go Test Parallelizer	9	9	0	100.0%	10,142,719
Avenger	7	7	0	100.0%	263,243
AI Moderator	6	6	0	100.0%	816
Contribution Check	5	5	0	80.0%	25,735
Issue Monster	5	5	0	80.0%	80,455
[aw] Failure Investigator (6h)	4	4	0	75.0%	350
Code Scanning Fixer	3	3	0	100.0%	18,784
PR Triage Agent	3	3	0	100.0%	56,288
Visual Regression Checker	2	2	0	100.0%	8,004
AW Essential Issue Clustering	1	1	0	100.0%	16,917
Actions and AW Linter Factory	1	1	0	100.0%	268,542
Agent Job Health Monitor	1	1	0	0.0%	0
Agent Performance Analyzer - Meta-Orchestrator	1	1	0	100.0%	7,717
Agent Persona Explorer	1	1	0	100.0%	61,363
Agentic Workflow Audit Agent	1	1	0	100.0%	5,565,733
Artifacts Usage Report	1	1	0	0.0%	1,920,210
CLI Version Checker	1	1	0	100.0%	4,467,525
Claude Code User Documentation Review	1	1	0	0.0%	108,628
Code Simplifier	1	1	0	100.0%	8,584
Constraint Solving — Problem of the Day	1	1	0	100.0%	30,973
Copilot Agent PR Analysis	1	1	0	100.0%	92,807
Copilot Agent Prompt Clustering Analysis	1	1	0	0.0%	28,282
Copilot CLI Deep Research Agent	1	1	0	100.0%	11,396
Copilot PR Prompt Pattern Analysis	1	1	0	0.0%	15,683
Copilot Session Insights	1	1	0	100.0%	83,078
Daily A/B Testing Advisor	1	1	0	0.0%	291,306
Daily AWF Spec Compiler Surfacing Review	1	1	0	100.0%	3,014,324
Daily Ambient Context Optimizer	1	1	0	100.0%	19,589
Daily Assign Issue To User	1	1	0	100.0%	6,701
Daily CLI Performance Agent	1	1	0	100.0%	1,023,514
Daily Cache Strategy Analyzer	1	1	0	100.0%	8,750,797
Daily Caveman Optimizer	1	1	0	100.0%	3,797
Daily Cli Tools Tester	1	1	0	0.0%	3,592,471
Daily Code Debt Cleanup — Aider	1	1	0	100.0%	9,476
Daily Code Metrics and Trend Tracking Agent	1	1	0	100.0%	63,758
Daily Compiler Quality Check	1	1	0	100.0%	3,119
Daily Container Image Security Scan	1	1	0	0.0%	24,900
Daily Credit Limit Test	1	1	0	100.0%	50,399
Daily Declarative Engine Improver	1	1	0	0.0%	0
Daily Discussion Report Dispatcher	1	1	0	100.0%	7,604
Daily Documentation Diagram	1	1	0	100.0%	1,794,957
Daily Documentation Updater	1	1	0	100.0%	1,193,888
Daily Ecosystem Explorer	1	1	0	100.0%	10,738
Daily Evals Feature Report	1	1	0	100.0%	206,573
Daily Formal Spec Verifier	1	1	0	0.0%	19,379
Daily GitHub Docs SEO Optimizer	1	0	1	100.0%	12,190
Daily Go Function Namer	1	1	0	0.0%	0
Daily Grader Audit	1	1	0	0.0%	23,172
Daily Graft Intelligence	1	1	0	100.0%	7,439
Daily Harness Experiment Proposer	1	1	0	100.0%	7,312
Daily Malicious Code Scan Agent	1	1	0	100.0%	11,543
Daily Max Ai Credits Test	1	1	0	0.0%	141,012
Daily PR Code Quality Review	1	1	0	0.0%	1,783
Daily Project Performance Summary Generator (Using MCP Scripts)	1	1	0	100.0%	999,734
Daily Rendering Scripts Verifier	1	1	0	100.0%	14,663
Daily SPDD Spec Planner	1	1	0	100.0%	12,290
Daily Safe Output Integrator	1	1	0	100.0%	8,555
Daily Safe Output Tool Optimizer	1	1	0	100.0%	17,642
Daily Safe Outputs Conformance Checker	1	1	0	100.0%	49,871
Daily Safe Outputs Git Simulator	1	1	0	100.0%	7,831
Daily Schema Consistency Audit	1	1	0	0.0%	843
Daily Security Observability Report	1	1	0	100.0%	19,557
Daily Spec Coverage Review	1	1	0	0.0%	1,038
Daily Spending Forecast	1	1	0	100.0%	1,419,788
Daily Storify	1	1	0	100.0%	734,766
Daily Sub-Agent Model Resolution Audit	1	1	0	100.0%	17,729
Daily Syntax Error Quality Check	1	1	0	100.0%	11,089
Daily Testify Uber Super Expert	1	1	0	100.0%	10,711
Daily VulnHunter Scan	1	1	0	100.0%	5,104
Daily Windows Defender Release Scan	1	1	0	100.0%	0
Daily Windows Terminal Integration Builder	1	1	0	100.0%	173,656
Daily Work Queue Formal Verification	1	1	0	0.0%	0
Daily Work Queues Report	1	1	0	100.0%	12,523
Daily Workflow Security Model	1	1	0	0.0%	13,445
Daily Workflow Updater	1	1	0	100.0%	8,511
Dead Code Removal Agent	1	1	0	100.0%	18,065
Delight	1	1	0	100.0%	12,409
Detection Analysis Report	1	1	0	0.0%	0
Dictation Prompt Generator	1	1	0	100.0%	8,913
Documentation Noob Tester	1	1	0	100.0%	13,677
Draft PR Cleanup	1	1	0	100.0%	734
Duplicate Code Detector	1	1	0	100.0%	16,236
ESLint Miner	1	1	0	100.0%	9,323
ESLint Monster	1	1	0	100.0%	177,873
ESLint Refiner	1	1	0	100.0%	49,188
Engine Conformance Dispatcher	1	1	0	0.0%	0
Enterprise Docs Audit	1	1	0	100.0%	10,582
GitHub API Consumption Report Agent	1	1	0	100.0%	377,361
GitHub MCP Remote Server Tools Report Generator	1	1	0	100.0%	66,277
GitHub Remote MCP Authentication Test	1	1	0	100.0%	92,392
Go Logger Enhancement	1	1	0	100.0%	19,514
Instructions Janitor	1	1	0	100.0%	38,042
Issue Arborist	1	1	0	100.0%	67,204
Linter Miner	1	1	0	100.0%	27,855
Lockfile Statistics Analysis Agent	1	1	0	100.0%	141,299
Multi-Device Docs Tester	1	1	0	100.0%	182,801
Package Specification Enforcer	1	1	0	100.0%	1,966,460
Package Specification Extractor	1	1	0	0.0%	39,168
Package Specification Librarian	1	1	0	100.0%	9,247
PureLock	1	1	0	100.0%	2,902,003
Safe Output Health Monitor	1	1	0	100.0%	102,031
Schema Consistency Checker	1	1	0	100.0%	1,287,230
Sergo - Serena Go Expert	1	1	0	100.0%	26,186
Smoke Claude Dynamic Workflow	1	1	0	100.0%	1,032
Smoke Issues	1	1	0	0.0%	0
Smoke Work Queue Dispatcher	1	1	0	0.0%	6,885
Smoke Work Queue Worker	1	1	0	100.0%	7,508
Squad Game Planner	1	1	0	0.0%	0
Static Analysis Report	1	1	0	100.0%	23,461
Step Name Alignment	1	1	0	100.0%	10,008
Sub-Issue Closer	1	1	0	100.0%	234,695
Team Status	1	1	0	100.0%	2,231
Terminal Stylist	1	1	0	100.0%	6,497,521
The Great Escapi	1	1	0	0.0%	10,648
Tidy	1	1	0	100.0%	9,889
Workflow Health Manager - Meta-Orchestrator	1	1	0	100.0%	12,207
Workflow Normalizer	1	1	0	100.0%	464,178
arXiv Paper Researcher: GitHub Agentic Workflows	1	1	0	100.0%	243,484
daily-experiment-report	1	1	0	100.0%	22,565
jsweep - JavaScript Unbloater	1	1	0	100.0%	13,765

View Historical Trend

Trend covers the last 30 days (26 of 30 days have data; gaps on 2026-10-10, 10-11, 10-14, and 11-01). Today's entry (2026-11-08) carries the partial-coverage caveat noted above.

Recommendations

1. Investigate the "Install AWF binary" step failures clustered 08:44–11:55 UTC on 2026-11-08 — this is a shared infrastructure symptom, not a per-workflow gh-aw-detection misconfiguration. Check the AWF release/CDN source for an outage in that window.
2. Auditor workflow (not flagged as a detection misconfiguration) shows 0% success across 20 runs in this window, but both its agent and detection jobs are skipped — the failure is in its custom Collect failure evidence job, out of scope for this detection-focused report but worth a separate look.
3. Re-run this report once collection isn't rate-limited to confirm full 24h coverage, since ~4 hours of the window (2026-11-07T23:14Z–03:18Z) were not analyzed.

References:

• §42466663422 — Engine Conformance Dispatcher, both agent and detection jobs failed on "Install AWF binary"
• §42464145373 — PR Sous Chef, detection job failed on "Install AWF binary" while agent succeeded
• §42442885574 — Auditor, agent/detection both skipped; failure is in the custom Collect failure evidence job (out of scope, noted for follow-up)

Generated by 🔎 Detection Analysis Report · claude · agent · ~132 AIC · ⌖ ~1 AIC · ⊞ 4.5K · ◷

• expires on Nov 11, 2026, 3:35 PM UTC-08:00

[github-actions[bot]]

This discussion has been marked as outdated by Detection Analysis Report.

A newer discussion is available at Discussion #76336.