Summary
Smoke test run for Claude engine, triggered by PR #28082 on 2026-04-23.
Overall Status: PARTIAL (1 test unavailable, 1 test skipped × 2)
Run URL: https://github.com/github/gh-aw/actions/runs/24837114207
PR Used for Review Testing: #28082 ("Run pre-agent-steps before MCP gateway startup")
Timestamp: 2026-04-23T13:15:00Z
Test Results
| # |
Test |
Result |
| 1 |
GitHub MCP Testing (last 2 merged PRs: #28079, #28078) |
✅ |
| 2 |
MCP Scripts GH CLI Testing (PRs #28082, #28080) |
✅ |
| 3 |
Serena MCP Testing (activated, 4 symbols found) |
✅ |
| 4 |
Make Build Testing (make build succeeded) |
✅ |
| 5 |
Playwright Testing (GitHub page title verified) |
✅ |
| 6 |
Tavily Web Search Testing (5 results for "GitHub Agentic Workflows") |
✅ |
| 7 |
File Writing Testing (/tmp/gh-aw/agent/smoke-test-claude-24837114207.txt) |
✅ |
| 8 |
Bash Tool Testing (file read back successfully) |
✅ |
| 9 |
Discussion Interaction Testing (discussion #28083 found, comic comment added) |
✅ |
| 10 |
Agentic Workflows MCP Testing (smoke-claude status) |
❌ Tool error: "failed to get workflow statuses" |
| 11 |
Slack Script Safe Output Testing (#smoke-tests) |
✅ |
| 12 |
Code Scanning Alert Safe Output Testing (dummy warning on README.md:1) |
✅ |
| 13 |
Update PR Testing (appended test message to PR #28082) |
✅ |
| 14 |
PR Review Comment Testing (2 comments on compiler_yaml_main_job.go & test file) |
✅ |
| 15 |
Submit PR Review Testing (COMMENT review submitted) |
✅ |
| 16 |
Resolve Review Thread Testing |
⚠️ Skipped — couldn't retrieve PRRT_ node IDs via available tools |
| 17 |
Add Reviewer Testing (added copilot to PR #28082) |
✅ |
| 18 |
Push to PR Branch Testing (smoke-test-files/smoke-claude-push-test.md) |
✅ |
| 19 |
Close PR Testing |
⚠️ Skipped — no safe test PR to close |
Test #10 Error Details
Agentic Workflows MCP status tool returned error: "failed to get workflow statuses" when querying for workflow smoke-claude. The MCP server was reachable but the status endpoint returned an error. Status file written to /tmp/gh-aw/agent/smoke-claude-status-24837114207.txt with error details.
Test Details
💥 [THE END] — Illustrated by Smoke Claude · ● 210.7K · ◷
Summary
Smoke test run for Claude engine, triggered by PR #28082 on 2026-04-23.
Overall Status: PARTIAL (1 test unavailable, 1 test skipped × 2)
Run URL: https://github.com/github/gh-aw/actions/runs/24837114207
PR Used for Review Testing: #28082 ("Run pre-agent-steps before MCP gateway startup")
Timestamp: 2026-04-23T13:15:00Z
Test Results
make buildsucceeded)/tmp/gh-aw/agent/smoke-test-claude-24837114207.txt)smoke-claudestatus)#smoke-tests)copilotto PR #28082)Test #10 Error Details
Agentic Workflows MCP status tool returned error:
"failed to get workflow statuses"when querying for workflowsmoke-claude. The MCP server was reachable but the status endpoint returned an error. Status file written to/tmp/gh-aw/agent/smoke-claude-status-24837114207.txtwith error details.Test Details
cmd/gh-aw/main.go(File + Function),cmd/gh-aw-wasm/main.go(File + Function) — 4 symbolsshared/daily-audit-chartscomposite import #28079 "Refactor audit workflows with newshared/daily-audit-chartscomposite import" (merged 2026-04-23T13:02:42Z) and Allowvulnerability-alertsin GitHub Actions schema validation for compiled workflows #28078 "Allowvulnerability-alertsin GitHub Actions schema validation for compiled workflows" (merged 2026-04-23T13:05:05Z)go build -ldflags "-s -w -X main.version=8560c49d9-dirty" -o gh-aw ./cmd/gh-aw