[audit-workflows] 🔍 Agentic Workflow Audit — 2026-07-17 (89.3% healthy, 19 fails all 0-turn copilot driver)

[github-actions[bot]]

🔍 Agentic Workflow Audit — 2026-07-17

Window: 07:46–21:07Z (~13.4h partial) · Runs: 177 · Success: 158 (89.3%) · Failures: 19
First audit in 11 days (prior: 2026-07-06). Health remains on the established 86–89% baseline — no novel anomalies; every failure maps to a known issue.

Key metrics

Engine	Runs	Fails	Success	Tokens
copilot	98	17	82.7%	5.02M
pi	35	0	100%	0.85M
claude	27	1	96.3%	0.84M
codex	13	1	92.3%	3.33M
gemini	2	0	100%	0.64M
antigravity	2	0	100%	0.00M

• Fleet tokens: 10.67M · Wasted on failed runs: ~387K (8 runs burned tokens then died at 0 turns)
• Missing tools: 0 · **Missing (redacted) 0 · MCP failures: 0
• All 19 failures are 0-turn driver failures (agent job dies before/at the AI turn). copilot accounts for 17 of 19.

📈 Trend charts

Workflow Health (30d)

Success rate holds at 89.3%, squarely on the multi-week 86–89% band. Failures stay concentrated in copilot's 0-turn driver family; pi/claude/codex remain near-perfect. No regression versus the 07-06 window.

Fleet Token Usage (days with reported data)

Today's 10.67M reflects a fuller metrics.TokenUsage capture, not a real spike — most prior days report null due to the standing token-reporting gap, so day-to-day token comparison stays unreliable. AI-credits remains the trustworthy cost signal.

⚠️ Failure clusters (all map to known issues)

1. Smoke CI — 6× 0-turn fail on push (chronic, recurrence → 7)

All 6 copilot/claude-sonnet-4.6 Execute GitHub Copilot CLI failures at 0-turn/0-tok on push to main. Known issue smoke-ci-copilot-cli-100pct-fail-on-push (first seen 2026-06-30). Single highest-ROI reliability fix — if Smoke CI is the copilot canary, its constant red likely signals a real copilot-CLI startup regression on main. Runs: §29576827481, §29569648210.

2. copilot-sdk longrun — 8× nonzero-token 0-turn fail (~387K tokens burned)

Eight copilot runs consumed real tokens then failed at 0 recorded turns: CLI Consistency Checker (82.7K), daily-experiment-report (68.6K), Daily Project Performance Summary (56.5K), The Daily Repository Chronicle (30.1K), Discussion Task Miner (23.3K), Smoke Copilot Sub Agents (19.3K), Copilot PR Conversation NLP Analysis (104K), Daily Max Ai Credits Test (2.9K — intentional credit test). Maps to copilot-sdk-longrun-agentjob-fail. This is wasted spend worth root-causing.

3. Avenger — 1× 0-tok fail (recurrence → 19)

claude/claude-haiku-4.5 0-tok/0-turn fail. Known avenger-err-config-no-structured-logs (ERR_CONFIG "no structured log entries" on follow-up engine invocation). Long-running P1 escalation.

4. codex Daily Cache Strategy Analyzer — 1× 0-tok fail (recurrence → 6)

codex 0-tok fail consistent with codex-gh-aw-binary-not-found-for-mcp (MCP setup can't locate gh-aw binary). §29604657433.

5. Metrics reporting gap — confirmed fleet-wide

metrics.Turns and metrics.EstimatedCost are 0 for all 177 runs (both success and failure) — so Turns=0 is a reporting artifact, not a failure signal. metrics.TokenUsage is populated inconsistently day-to-day. Known token-usage-reporting-gap (recurrence → 4).

✅ Next actions (evidence-based)

1. [P1] Root-cause Smoke CI copilot-CLI 0-turn fail — 6/6 on push again today, chronic across 7 windows. Add a fast-fail diagnostic dumping why the CLI aborts 0-turn; muting/fixing lifts prod-main reliability materially.
2. [P1] Root-cause copilot-sdk longrun 0-turn family — 8 runs burned ~387K tokens then died; this is both a reliability and cost leak concentrated entirely in copilot.
3. [P1] Avenger err-config — restore structured logs on follow-up invocation (19th recurrence).
4. [P2] Fix codex gh-aw-binary MCP path — recurring codex-engine startup failure.
5. [P2] Close/document the metrics gap — restore metrics.Turns/EstimatedCost/TokenUsage, or officially switch cost charts to AI-credits.

copilot is the fleet's sole reliability weak point (82.7% vs pi/claude/codex ≥92%); every open failure family is copilot-engine 0-turn driver-level.

References:

• §29576827481 — Smoke CI fail
• §29565417785 — Avenger fail
• §29604657433 — codex Cache Strategy fail

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🔍 Agentic Workflow Audit Agent · 225.3 AIC · ⌖ 39 AIC · ⊞ 7.4K · ◷

• expires on Jul 18, 2026, 1:42 PM UTC-08:00

[github-actions[bot]]

This discussion has been marked as outdated by Agentic Workflow Audit Agent.

A newer discussion is available at Discussion #46492.