[audit-workflows] Daily Agentic Workflow Audit — 2026-08-12

[github-actions[bot]]

Window: 2026-08-11T21:28Z → 2026-08-12T21:xxZ (full 24h, 305 unique runs, 4 paginated fetches)
Success rate: 85.9% raw (262/305) / 86.2% ex-intentional (261/304, excluding 1 deliberate "Daily Max Ai Credits Test" guardrail trip)
Note: This is the first audit since 2026-07-06 — a 5-week gap in audit cadence (flagged as a resolved anomaly, see below).

Success rate has held in the mid-to-high 80s since the last data point on 2026-07-06, with no visible cliff despite the unmonitored gap. Today's 43 failures split roughly 65% infra-level (driver_exit) vs 32% agent-logic (agent_logic), plus 1 intentional test.

Key findings

1. Claude CLI driver_exit cluster, including 2 post-fix failures (HIGH)
   13 of 28 driver_exit failures share the step name "Execute Claude Code CLI" across unrelated workflows (Design Decision Gate, Avenger, AstroStyleLite, Go Logger Enhancement, Step Name Alignment, AgentRx Trace Optimizer, Elixir Credo Snippet Audit, AW Cross-Repo Compile Check, Choice Type Test, Blog Auditor, Failure Investigator (6h), Daily Caveman Optimizer, Daily Code Debt Cleanup). PR Retry cold-start Claude connection refusals as fresh runs #52198 ("Retry cold-start Claude connection refusals as fresh runs") merged today at 18:35Z, but 2 of these failures — §31631087083 and §31640223460 — ran with cli_version=cccc09a (the fix commit) and still hit driver_exit. This suggests the fix's scope doesn't cover every cold-start failure mode, not merely that the fix hasn't rolled out yet. Recommend: compare the specific error signature in these 2 post-fix runs against what PR Retry cold-start Claude connection refusals as fresh runs #52198 targets to check for a gap.

2. Code Scanning Fixer — 75% failure rate, recurring (HIGH)
   3 of 4 runs failed with 0-token/empty-turn agent job failures. This is a known issue (code-scanning-fixer-0tok-agentjob-fail) first seen 2026-06-25, now 7 weeks unresolved and still at 75% fail rate.

3. New cluster: binary-install driver_exit flakiness (MEDIUM)
   4 driver_exit failures across PR Sous Chef, AI Moderator, GPL Dependency Cleaner, and Failure Investigator (6h) trace to a shared setup step — "Install AWF binary" / "Install GitHub Copilot CLI" / "Install threat-detect binary" — not agent logic. Notably PR Sous Chef's 3 failures this window are entirely this infra issue, not the agent itself misbehaving. Recommend: add retry-with-backoff to the shared binary-install action.

4. Fleet-wide tooling health: 0 missing-tool, 0 missing-data, and 0 MCP-failure safe-outputs this window — no gaps in tool/data availability were reported by any run.

Token & cost trend

Today's total is ~20.6M tokens (sum of per-page totals; may include minor double-counting of ~6 runs at pagination boundaries) against a 7-day moving average that last had data on 2026-07-06. Top consumers this window: Daily Evals Feature Report (3.46M), Daily Cache Strategy Analyzer (3.40M), Duplicate Code Detector (2.50M), Daily Observability Report for AWF Firewall and MCP Gateway (1.22M), Daily Go Test Parallelizer (861K), Issue Arborist (558K). Total actuation-instruction-count (AIC) across all runs was ~13,273.

Full failure taxonomy (28 driver_exit + 14 agent_logic + 1 intentional)

Workflow	Failed step	Class
Design Decision Gate 🏗️	Execute Claude Code CLI	driver_exit
Daily Documentation Healer	Execute Claude Code CLI	driver_exit
Avenger	Execute Claude Code CLI	driver_exit
GPL Dependency Cleaner (gpclean)	Install GitHub Copilot CLI	driver_exit
Daily AstroStyleLite Markdown Spellcheck	Execute Claude Code CLI	driver_exit
Go Logger Enhancement	Execute Claude Code CLI	driver_exit
Step Name Alignment	Execute Claude Code CLI	driver_exit
GitHub Remote MCP Authentication Test	Execute GitHub Copilot CLI	driver_exit
Daily AgentRx Trace Optimizer	Execute Claude Code CLI	driver_exit
Daily Container Image Security Scan	Enforce critical vulnerability and license gates	driver_exit
Daily Elixir Credo Snippet Audit	Execute Claude Code CLI	driver_exit
arXiv Paper Researcher: GitHub Agentic Workflows	Execute Crush CLI	driver_exit
Daily AW Cross-Repo Compile Check	Execute Claude Code CLI	driver_exit
Daily Choice Type Test	Execute Claude Code CLI	driver_exit
Daily Max Ai Credits Test	Execute GitHub Copilot CLI	driver_exit (intentional)
Blog Auditor	Execute Claude Code CLI	driver_exit
Agent Performance Analyzer - Meta-Orchestrator	Execute GitHub Copilot CLI	driver_exit
CI Optimization Coach	Execute GitHub Copilot CLI	driver_exit
CLI Consistency Checker	Execute GitHub Copilot CLI	driver_exit
Daily Fact	Check KVM availability for docker-sbx	driver_exit
PR Sous Chef ×3	Install AWF binary	driver_exit
Daily Code Metrics and Trend Tracking Agent	Execute Crush CLI	driver_exit
[aw] Failure Investigator (6h)	Execute Claude Code CLI / Install AWF binary	driver_exit
Daily Code Debt Cleanup — Aider	Check workflow lock file	driver_exit
PR Sous Chef ×2 (dup grouping)	Install GitHub Copilot CLI / Install threat-detect binary	driver_exit
AI Moderator	Install AWF binary	driver_exit
Daily Caveman Optimizer	Execute Claude Code CLI	driver_exit
Code Scanning Fixer ×3	(agent logic, 0-token empty turn)	agent_logic

Recommendations

Priority	Recommendation
HIGH	Verify PR #52198's cold-start retry fix covers the failure mode seen in §31631087083 and §31640223460 — both ran post-merge and still hit driver_exit.
HIGH	Re-investigate Code Scanning Fixer's 0-token/empty-turn agent job failures — 75% fail rate, unresolved for 7 weeks.
MEDIUM	Add retry-with-backoff to the shared binary-install setup step (AWF/Copilot-CLI/threat-detect) — 4 failures this window across 3+ workflows, all infra-level.

Repo memory

Updated all 6 tracked files: known-issues.json (16 issues, 2 recurrences bumped + 1 new), recommendations.json (+3), anomalies.json (+2, incl. resolved 5-week audit-gap anomaly), metrics-summary.json, audit-history.jsonl, workflow-trends.json (74 workflows tracked).

References:

• §31631087083
• §31640223460
• §31621521625

Generated by 🔍 Agentic Workflow Audit Agent · agent · 287.1 AIC · ⌖ 42.5 AIC · ⊞ 8.4K · ◷

• expires on Aug 13, 2026, 1:51 PM UTC-08:00