Smoke Test: Claude - 23271918855 #21676
Description
Summary
Smoke test run for Claude engine on 2026-03-18. Overall status: PARTIAL (some tests skipped due to constraints).
Run URL: https://github.com/github/gh-aw/actions/runs/23271918855
PR used for review tests: #21672
Core Tests (#1–10)
| # | Test | Status | Notes |
|---|---|---|---|
| 1 | GitHub MCP — last 2 merged PRs | ✅ | Found #21664, #21660 |
| 2 | MCP Scripts GH CLI — 2 PRs | ✅ | Found #21672, #21645 |
| 3 | Serena MCP — activate + find symbols | ✅ | 16 symbols found in cmd/gh-aw/main.go |
| 4 | Make Build | ✅ | make build succeeded |
| 5 | Playwright — github.com title | ✅ | Title contains "GitHub" |
| 6 | Tavily Web Search | ✅ | 5 results for "GitHub Agentic Workflows" |
| 7 | File Writing | ✅ | /tmp/gh-aw/agent/smoke-test-claude-23271918855.txt created |
| 8 | Bash Tool | ✅ | File read back successfully |
| 9 | Discussion Interaction | ✅ | Discussion #21670, comment added |
| 10 | Agentic Workflows MCP | ✅ | smoke-claude workflow is active |
PR Review Tests (#11–17)
| # | Test | Status | Notes |
|---|---|---|---|
| 11 | Update PR Body | ✅ | Appended test message to PR #21672 |
| 12 | PR Review Comments | ✅ | 2 comments on ace-editor.lock.yml lines 90, 347 |
| 13 | Submit PR Review | ✅ | COMMENT review submitted |
| 14 | Resolve Review Thread | Skipped — GitHub MCP returned no threads for PR | |
| 15 | Add Reviewer | ✅ | Added copilot as reviewer |
| 16 | Push to PR Branch | Skipped — .txt files are gitignored in this repo |
|
| 17 | Close PR | Skipped — no safe test PR to close |
Overall Status: PARTIAL
All non-skipped tests passed. Skipped tests were due to environment constraints (gitignore rules, no resolvable review threads, no test PR to close), not failures.
Agentic Workflows MCP Details
Workflow: smoke-claude
Engine: claude
Compiled: Yes
Status: active
Triggers: pull_request (labeled: smoke), reaction: heart, schedule: every 12h, status-comment: true
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 19, 2026, 1:32 AM UTC