Workflow Health Dashboard - 2026-03-07 #19935
Description
Overview
| Metric | Value |
|---|---|
| Total executable workflows | 166 (stable) |
| Compiled with lock files | 166/166 (100% ✅) |
| Outdated lock files | 12 |
| Healthy | ~154 (93%) |
| Critical/Failing (P1) | 6 workflows |
| Overall health score | 74/100 (↓2 from 76 — 12 outdated lock files detected) |
⚠️ DEGRADED — Lockdown failures ongoing + Smoke Codex OpenAI restriction (day 10) + 12 lock files newly outdated. Issues #18919 (Issue Monster) and #18922 (AI Moderator) expire TODAY (Mar 7). Dashboard #19814 also expired.
Critical Issues 🚨
P1: Lockdown Token Missing (4 workflows)
- Issue Monster — run Add safe-output-health workflow to monitor safe output job failures #2525 failed today (2026-03-07T07:15Z) — issue [aw] Issue Monster failed #18919 OPEN
⚠️ expires TODAY (9:09 PM UTC) - PR Triage Agent — run Add integration testing workflow for agentics repository compatibility with build system improvements #176 failed today (2026-03-07T06:15Z) — issue [aw] PR Triage Agent failed #18952 OPEN (expires Mar 8)
- Daily Issues Report — run Implement output field for automatic GitHub issue creation with comprehensive documentation #125 failed today (2026-03-07T01:58Z) — issue [aw] Daily Issues Report Generator failed #18967 OPEN (expires Mar 8, 2:01 AM)
- Org Health Report — run Small docs fixes #27 failed (last run 2026-03-02) — NO dedicated tracking issue
Root cause: lockdown: true requires GH_AW_GITHUB_TOKEN secret (not provisioned). No fix path — #17414 and #17807 both CLOSED "not_planned". Manual intervention required.
P1: AI Moderator — Day 10 (Intermittent, partial recovery)
- Recent status (2026-03-07): run Make item_number optional for add_comment safe output tool #9603 ✅ success (04:10Z), run [aw] Dictation Prompt Generator failed #9596 ✅ success, run [aw] Agent Performance Analyzer - Meta-Orchestrator failed #9591 ❌ failure (Mar 6, 21:10Z)
- Issue [aw] AI Moderator failed #18922 OPEN (63+ comments)
⚠️ expires TODAY (9:45 PM UTC) - Error: OpenAI cybersecurity restriction on
gpt-5.3-codex— intermittent - Pattern: Some event types succeed (comment events), specific issue types trigger failures
P1: Smoke Codex — OpenAI Cybersec Restriction (Day 10)
- Run [audit] Agentic Workflows blog audit - PASSED #2169 failed today (2026-03-07T00:51Z) — consistent daily failures
- Active tracking: issues [aw] Smoke Codex failed #18933 (OPEN) and [aw] Smoke Codex failed (pre-agent) #19514 (OPEN)
- Issue Smoke Codex failing: OpenAI cybersecurity restriction now affecting codex smoke test #19634 was CLOSED "not_planned" on Mar 6
- Same OpenAI cybersecurity restriction as AI Moderator
⚠️ Expiring Issues (Action Required Today)
| Issue | Workflow | Expires | Status |
|---|---|---|---|
| #18919 | Issue Monster | TODAY 9:09 PM UTC | Underlying issue NOT resolved |
| #18922 | AI Moderator | TODAY 9:45 PM UTC | Partially recovered — monitor |
| #19814 | Dashboard (prev) | EXPIRED ~7:33 AM UTC | Replaced by this issue |
| #18952 | PR Triage Agent | Mar 8 | Underlying issue NOT resolved |
| #18967 | Daily Issues Report | Mar 8, 2:01 AM UTC | Underlying issue NOT resolved |
🆕 New Finding: 12 Outdated Lock Files
These workflow .md files are newer than their corresponding .lock.yml files and require recompilation (make recompile):
View 12 workflows needing recompilation
blog-auditor.mdcloclo.mdcopilot-cli-deep-research.mdcopilot-pr-prompt-analysis.mddaily-rendering-scripts-verifier.mddaily-team-evolution-insights.mddev-hawk.mdpdf-summary.mdrepository-quality-improver.mdsmoke-temporary-id.mdstatic-analysis-report.mdtypist.md
Action: Run make recompile to regenerate all lock files. These workflows may be running with stale configurations.
Healthy Workflows ✅
Healthy workflow highlights
- Smoke Copilot: ✅ run [smoke-detector] 🚨 CRITICAL: GenAIScript Failure Persists After Model Fix - 7th Consecutive Failure (API Key or Service Issue) #2272 success (2026-03-07T01:12Z)
- Smoke Claude: ✅ run [Schema Consistency] 🔍 Schema Consistency Analysis - 8 Inconsistencies Found (2025-10-23) #2196 success (2026-03-07T00:50Z)
- AI Moderator: Partially recovered — mostly succeeding on comment events
- All other scheduled workflows outside P1 category operating normally
Recommendations
High Priority (Today)
- TODAY: Issues [aw] Issue Monster failed #18919 (Issue Monster) and [aw] AI Moderator failed #18922 (AI Moderator) expire today — auto-close without resolution unless renewed
make recompile: 12 workflows have outdated lock files — developer action needed- Org Health Report: No tracking issue exists — create one or accept ongoing failure
Medium Priority
- OpenAI restriction: AI Moderator and Smoke Codex both blocked on day 10 — investigate switching to alternative model (claude/copilot engine) or contact OpenAI
- Manual intervention for lockdown: All 4 lockdown workflows need admin decision on
GH_AW_GITHUB_TOKEN
Health Trends
| Date | Score | Workflows | Key Change |
|---|---|---|---|
| 2026-02-25 | 78/100 | 158 | All lockdown fix paths closed |
| 2026-03-01 | 73/100 | 162 | Metrics Collector regression |
| 2026-03-03 | 76/100 | 165 | Metrics Collector recovered |
| 2026-03-06 | 76/100 | 166 | +1 workflow; 3 issues expiring |
| 2026-03-07 | 74/100 | 166 | 12 outdated lock files; #18919 #18922 expire today |
Actions Taken This Run
- ✅ Verified 166/166 workflows compiled
- ✅ Detected 12 genuinely outdated lock files (new finding)
- ✅ Confirmed Issue Monster: still failing (run Add safe-output-health workflow to monitor safe output job failures #2525, 2026-03-07T07:15Z)
- ✅ Confirmed Smoke Copilot: PASSING (run [smoke-detector] 🚨 CRITICAL: GenAIScript Failure Persists After Model Fix - 7th Consecutive Failure (API Key or Service Issue) #2272)
- ✅ Confirmed Smoke Codex: still failing (run [audit] Agentic Workflows blog audit - PASSED #2169)
- ✅ Confirmed AI Moderator: partially recovered (success on comment events)
- ✅ Updated shared memory
- ✅ Created this dashboard (replacing Workflow Health Dashboard - 2026-03-06 #19814 which expired)
References:
- §22794578625 — This run
- Previous dashboard: §22753540957 — Workflow Health Dashboard - 2026-03-06 #19814 (2026-03-06)
Generated by Workflow Health Manager - Meta-Orchestrator · ◷
- expires on Mar 8, 2026, 7:25 AM UTC