Skip to content

[Outcome Report] Outcome Report — Safe Outputs — 2026-05-26 #34831

@github-actions

Description

@github-actions

Outcome Scorecard — 2026-05-26

Metric Value Status
Acceptance rate 71.4% 🟡 60-80%
Zero-touch rate 0% 🔴 <25%
Waste rate 8% 🟢 <10%
Median time to resolution 1h 15m
Accepted 5 / 25
Rejected 2
Zero-touch 0 / 5
Pending 18
Runs checked 6

🔴 Action Items

  1. Regressing acceptance rate — Acceptance dropped from 100% (2026-05-25) to 71.4% today. Two workflows had rejections: "Design Decision Gate 🏗️" and "Test Quality Sentinel" both have 50% waste rates with items pending >45 minutes. Review these workflows' prompts and output quality.

  2. Stuck pending items — 18 items pending, with 4 PR review items pending >45 minutes ("Matt Pocock Skills Reviewer" and "PR Code Quality Reviewer"). These may be blocked on external events or timeouts. Investigate if these workflows need timeout logic.

  3. Zero zero-touch outcomes — All 5 accepted items required manual review/edits. This indicates output quality issues across accepted items. Review agent prompts for clarity and accuracy.

Per-Workflow Breakdown

Workflow Accepted Rejected Pending Acceptance Waste Status
Design Decision Gate 🏗️ 0 1 1 0% 🔴 50% Needs investigation
Test Quality Sentinel 0 1 1 0% 🔴 50% Needs investigation
Matt Pocock Skills Reviewer 0 0 4 N/A 0% All pending >45min
PR Code Quality Reviewer 0 0 4 N/A 0% All pending >45min
Issue Monster 3 0 3 50% 0% Healthy
Smoke Copilot 2 0 5 29% 0% Many pending <4min
Detailed Outcomes

Accepted Outcomes

  1. Smoke Copilot — create_discussion (discussion copilot was here #34823)
  2. Smoke Copilot — create_issue (issue Smoke Test: Copilot - 26426709615 #34824)
  3. Issue Monster — add_comment on issue [deep-report] [quick-win] Fix 3 broken doc-link anchors in main_workflow_schema.json #34686
  4. Issue Monster — add_comment on issue [performance] Regression in ParseWorkflow: +34.3% slower #34694
  5. Issue Monster — add_comment on issue [refactor] Duplicate engine MCP/log scaffolding and dead SafeOutputStepConfig type in pkg/workflow #34800

Rejected Outcomes

  1. Test Quality Sentinel — add_comment on PR perf(validation): remove YAML parse hot path in permission scope validation #34797 (closed PR, resolution 1h 15m)
  2. Design Decision Gate 🏗️ — add_comment on PR perf(validation): remove YAML parse hot path in permission scope validation #34797 (closed PR, resolution 1h 15m)

Critical Pending Items (>45 minutes)

  • Matt Pocock Skills Reviewer (4 items) — create_pull_request_review_comment pending 45+ minutes
  • PR Code Quality Reviewer (4 items) — create_pull_request_review_comment pending 45+ minutes
  • Test Quality Sentinel (1 item) — submit_pull_request_review pending 46+ minutes
  • Design Decision Gate 🏗️ (1 item) — push_to_pull_request_branch pending 46+ minutes
  • Smoke Copilot (5 items) — Various safe-output operations pending 0-4 minutes

Trend Analysis

⬇️ Regressing: Acceptance rate dropped 28.6 percentage points (100% → 71.4%). First rejections observed today. Zero-touch rate remains at 0%.

Previous day (2026-05-25): 100% acceptance, 0% waste, 29 outcomes, 14 runs

Today (2026-05-26): 71.4% acceptance, 8% waste, 25 outcomes, 6 runs

📊 Measured by Outcome Collector · haiku45 29.4K

  • expires on Jun 2, 2026, 1:33 AM UTC

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions