Smoke Test: Claude - 23563803890 #22978
Description
Summary
Automated smoke test run for Claude engine — PARTIAL (all core tests passed, 2 skipped).
Run: §23563803890
Timestamp: 2026-03-25T21:02:18Z
PR used for review testing: #22938 — feat: add post cleanup script to actions/setup to erase /tmp/gh-aw/
Core Tests (#1–11)
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP: Review last 2 merged PRs | ✅ PR #22932, PR #22969 |
| 2 | MCP Scripts GH CLI: Query 2 PRs | ✅ PR #22974, PR #22973 |
| 3 | Serena MCP: Activate project + find symbols | ✅ main symbol found (cmd/gh-aw/main.go:827) |
| 4 | Make Build Testing | ✅ Build succeeded |
| 5 | Playwright: GitHub page title | ✅ "GitHub · Change is constant..." |
| 6 | Tavily Web Search: GitHub Agentic Workflows | ✅ 5 results returned |
| 7 | File Writing: smoke-test-claude-23563803890.txt | ✅ Created and verified |
| 8 | Bash Tool: Verify file via cat | ✅ Content confirmed |
| 9 | Discussion Interaction: Comment on #22971 | ✅ Comic-book comment added |
| 10 | Agentic Workflows MCP: smoke-claude status | ✅ Active, engine: claude, triggers: PR/reaction/schedule |
| 11 | Slack Script Safe Output | ✅ Posted to #smoke-tests |
PR Review Safe Output Tests (#12–18)
| # | Test | Result |
|---|---|---|
| 12 | Update PR body (append) | ✅ Appended to PR #22938 |
| 13 | PR Review Comments (2 inline) | ✅ Added to .changeset and .lock.yml files |
| 14 | Submit PR Review (COMMENT) | ✅ Review submitted |
| 15 | Resolve Review Thread | |
| 16 | Add Reviewer (copilot) | ✅ Reviewer added |
| 17 | Push to PR Branch | |
| 18 | Close PR (conditional) |
Overall Status: PARTIAL (all non-skipped tests passed, 3 skipped)
Agentic Workflows Status Details
Workflow: smoke-claude
Engine: claude
Compiled: Yes
Status: active
Triggers: pull_request (labeled: smoke), reaction: heart, schedule: every 12h, status-comment: true
Note
🔒 Integrity filter blocked 2 items
The following items were blocked because they don't meet the GitHub integrity level.
- #22969
search_pull_requests: has lower integrity than agent requires. The agent cannot read data with integrity below "approved". - feat: add post cleanup script to actions/setup to erase /tmp/gh-aw/ #22938
pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools:
github:
min-integrity: approved # merged | approved | unapproved | none💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 25, 2026, 11:08 PM UTC