Automated smoke test run for the Claude engine on 2026-04-24.
Run URL: https://github.com/github/gh-aw/actions/runs/24891531297
Timestamp: 2026-04-24T13:20:00Z
PR Under Test: #28200 (copilot/update-cli-tools-versions-another-one)
Test Results
| # |
Test |
Result |
Notes |
| 1 |
GitHub MCP — review last 2 merged PRs |
✅ |
#28195, #28194 |
| 2 |
MCP Scripts GH CLI — query 2 PRs |
✅ |
#28257, #28255 |
| 3 |
Serena MCP — activate project + find symbols |
✅ |
7 symbols found |
| 4 |
Make Build |
⚠️ |
mcpscripts-make timed out; go build ./... succeeded |
| 5 |
Playwright — navigate to github.com |
✅ |
Title: "GitHub · Change is constant..." |
| 6 |
Tavily Web Search — "GitHub Agentic Workflows" |
✅ |
3 results returned |
| 7 |
File Writing — create test file |
✅ |
/tmp/gh-aw/agent/smoke-test-claude-24891531297.txt |
| 8 |
Bash — verify file contents |
✅ |
cat confirmed contents |
| 9 |
Discussion Interaction |
✅ |
Got discussion #28270 |
| 10 |
Agentic Workflows MCP — status smoke-claude |
❌ |
Error: "failed to get workflow statuses" |
| 11 |
Slack Safe Output |
✅ |
Posted to #smoke-tests |
| 12 |
Code Scanning Alert |
✅ |
Dummy warning posted |
| 13 |
Update PR Body |
✅ |
Appended test message to PR #28200 |
| 14 |
PR Review Comments |
✅ |
2 inline comments on PR #28200 |
| 15 |
Submit PR Review |
✅ |
COMMENT review submitted |
| 16 |
Resolve Review Thread |
✅ |
Thread PRRT_kwDOPc1QR859TFxn resolved |
| 17 |
Add Reviewer |
✅ |
Copilot added as reviewer |
| 18 |
Push to PR Branch |
✅ |
smoke-test-files/smoke-claude-push-test.md pushed |
| 19 |
Close PR (conditional) |
⚠️ |
Skipped — no safe test PR to close |
Overall Status: PARTIAL
- 1 failed: Test 10 (Agentic Workflows MCP status tool unavailable)
- 2 skipped/partial: Test 4 (mcpscripts-make timeout, go build OK), Test 19 (no test PR)
- 16 passed
Error Details
Test 10 — Agentic Workflows MCP:
Error: MCP error -32603: calling "tools/call": failed to get workflow statuses
Query: smoke-claude
Test 4 — Make Build:
Error: MCP error -32005: timeout awaiting response headers
Fallback: go build ./... → SUCCESS
💥 [THE END] — Illustrated by Smoke Claude · ● 289K · ◷
Automated smoke test run for the Claude engine on 2026-04-24.
Run URL: https://github.com/github/gh-aw/actions/runs/24891531297
Timestamp: 2026-04-24T13:20:00Z
PR Under Test: #28200 (copilot/update-cli-tools-versions-another-one)
Test Results
mcpscripts-maketimed out;go build ./...succeeded/tmp/gh-aw/agent/smoke-test-claude-24891531297.txtcatconfirmed contentssmoke-claudesmoke-test-files/smoke-claude-push-test.mdpushedOverall Status: PARTIAL
Error Details
Test 10 — Agentic Workflows MCP:
Test 4 — Make Build: