Safe Output Health Report - 2026-03-25

[github-actions[bot]]

Executive Summary

• Period: Last 24 hours (2026-03-25)
• Runs Analyzed: 10 (summarized) + 29 sub-runs/partial entries
• Workflows Active with Safe Outputs: 3
• Safe Output Messages Executed: 8 (7 successful, 1 skipped custom job)
• Safe Output Job Failures: 0
• Error Clusters Identified: 0 failures — 1 recurring warning (non-fatal)
• Overall Safe Output Success Rate: 100% ✅

Today was a clean run with no safe output failures. All safe output handler jobs completed successfully.

---

Safe Output Job Statistics

Job Type	Executions	Failures	Success Rate
missing_data	1	0	100%
create_discussion	2	0	100%
add_comment	1	0	100%
dispatch_workflow	1	0	100%
create_issue	1	0	100%
set_issue_type	1	0	100%
send_slack_message	1	0	100% (custom job, skipped by handler)

Total: 8 messages across 3 workflow runs, 7 executed + 1 custom-handled. Zero failures.

---

Workflow Run Details

AI Moderator — run-23541649621

• Engine: Codex
• Event: Issue opened (Assign to agent seems to be limited for 1 assignment per issue, I would like to extend it to multiple assignments so agent can work on multiple repos. #22897)
• Safe Output: 1 × missing_data
• Result: ✅ Success
• Notes: The AI Moderator could not retrieve the issue content because the GitHub MCP response withheld it due to the DIFC integrity policy (below required integrity). The agent correctly reported missing_data with context: "Moderation requires unsanitized title/body text, but the GitHub MCP response withheld the issue resource due to integrity policy." This is expected behavior — the safe output handler recorded the missing data correctly.

Constraint Solving — Problem of the Day — run-23541908942

• Engine: Copilot
• Event: Schedule
• Safe Output: 1 × create_discussion
• Result: ✅ Success (with warning)
• Discussion Created: #22898 — "🧩 Constraint Solving POTD:Constraint Acquisition — Learning Constraint Models from Data"
• Older Discussion Closed: 🧩 Constraint Solving POTD:SMT — Scheduling Tasks with Mixed Boolean-Arithmetic Constraints #22682 successfully closed
• Warning: ⚠️ Could not find label IDs for: constraint-solving, problem-of-the-day — labels not present in repository. Discussion was created and older one closed successfully; only labels were not applied. (Pattern EP_LABELS_MISSING — 2nd consecutive day)

Smoke Copilot — run-23541922245

• Engine: Copilot
• Event: Schedule
• Safe Output: 6 messages
• Result: ✅ 5/6 successful, 1 skipped (custom job)
• Actions taken:
  1. add_comment → ✅ Comment posted to discussion Terminal Stylist: Console Output Analysis Report — gh-aw #22882
  2. dispatch_workflow → ✅ Dispatched haiku-printer workflow
  3. create_discussion → ✅ Created (older smoke-copilot discussion closed)
  4. create_issue → ✅ Created issue Smoke Test: Copilot - 23541922245 #22900, sub-issue of new group Smoke Copilot - Issue Group #22901
  5. set_issue_type → ✅ Set type to "Bug" on issue Smoke Test: Copilot - 23541922245 #22900
  6. send_slack_message → ⏭️ Skipped (custom safe output job — logged in manifest)

---

Error Clusters

No error clusters today. All safe output operations completed successfully.

---

Warnings

⚠️ EP_LABELS_MISSING — Missing Labels in Repository (2nd consecutive day)

• Count: 1 occurrence (also 1 yesterday)
• Affected Job: create_discussion → add_labels step
• Affected Workflow: Constraint Solving — Problem of the Day
• Run: §23541908942
• Message:

  ##[warning]Could not find label IDs for: constraint-solving, problem-of-the-day
  These labels may not exist in the repository.
  

• Root Cause: The constraint-solving-potd workflow frontmatter specifies labels: ["constraint-solving", "problem-of-the-day"], but these labels have not been created in the github/gh-aw repository. The discussion is created successfully; only the label application step fails silently.
• Impact: Low — discussion created and published correctly. Labels are cosmetic only.
• Action: Create missing labels or remove them from the workflow config.

---

Root Cause Analysis

Safe Output Job Skips (Out of Scope)

28+ runs had their safe_outputs jobs skipped because the detection job failed (detection.result == 'failure'). This is expected behavior — the conditional gate prevents safe output execution when detection hasn't validated agent output. Affected workflows include Smoke Gemini, Auto-Triage Issues (x2), Smoke Update Cross-Repo PR, and Smoke Create Cross-Repo PR. These detection failures are handled by separate monitoring workflows and are out of scope for this audit.

---

Recommendations

Non-Critical (Low Priority)

1. Create missing labels for constraint-solving-potd (EP_LABELS_MISSING)
   • Priority: Low
   • Root Cause: Labels constraint-solving and problem-of-the-day referenced in frontmatter don't exist in repository
   • Recommended Action: Run gh label create constraint-solving --color "#0075ca" and gh label create problem-of-the-day --color "#e4e669" in github/gh-aw
   • Affected Workflow: Constraint Solving — Problem of the Day
   • Observed: 2 consecutive days (2026-03-24, 2026-03-25)

---

Work Item Plans

Work Item 1: Create Missing Labels for constraint-solving-potd

• Type: Configuration Fix
• Priority: Low
• Description: The constraint-solving and problem-of-the-day labels referenced in the constraint-solving-potd workflow do not exist in the github/gh-aw repository. This causes a non-fatal warning on every run of this daily workflow.
• Acceptance Criteria:
  • Labels constraint-solving and problem-of-the-day created in github/gh-aw
  • Next run of Constraint Solving POTD applies labels without warning
• Technical Approach: Create labels via GitHub API or via repo settings
• Estimated Effort: Small (< 5 minutes)
• Dependencies: None

---

Historical Context

Date	Runs	Safe Output Executions	Failures	Success Rate
2026-03-24	234	16	1	96.97%
2026-03-23	100	?	0	100%
2026-03-22	110	?	2	93.8%
2026-03-25	10	3	0	100% ✅

Note: Today's run count is significantly lower than recent days — only 10 summarized runs appear in the 24h window (vs 234 yesterday). This may reflect different scheduling patterns or a quiet period on the main branch.

Trends

• Error rate trend: Improving — 100% success today after 1 failure yesterday
• Most common recurring warning: EP_LABELS_MISSING (constraint-solving-potd), 2nd consecutive day
• Previously active patterns not observed today: EP022 (push_to_pull_request_branch branch missing), EP021 (PR review path resolution), EP007 (auto-merge)

---

Metrics and KPIs

• Overall Safe Output Success Rate: 100% (7/7 executed messages)
• Most Reliable Job Type: All — no failures across any job type
• Custom Jobs (external handlers): 1 × send_slack_message correctly skipped
• Temporary ID Registrations: 1 (aw_smoke1 → Smoke Test: Copilot - 23541922245 #22900)

---

Next Steps

• Create labels constraint-solving and problem-of-the-day in repo (EP_LABELS_MISSING fix)
• Monitor EP_LABELS_MISSING — if persists beyond 3 days, escalate to workflow owner
• Continue monitoring EP022 and EP021 patterns from yesterday — not observed today but were recurring

---

References:

• §23541649621 — AI Moderator
• §23541908942 — Constraint Solving POTD
• §23541922245 — Smoke Copilot

AI generated by Safe Output Health Monitor · history

• expires on Mar 26, 2026, 1:18 PM UTC

[github-actions[bot]]

This discussion has been marked as outdated by Safe Output Health Monitor.

A newer discussion is available at Discussion #23123.