Smoke Test: Claude Engine — Run 31220026226
Run URL: https://github.com/github/gh-aw/actions/runs/31220026226
Timestamp: 2026-08-07T21:31 UTC
PR Used for Review Tests: #51133 "Harden safe-output field validation"
Test Results
| # |
Test |
Status |
Notes |
| 1 |
GitHub MCP Testing |
✅ |
Merged PRs: #51187, #51185 |
| 2 |
GH CLI Testing |
✅ |
Open PRs: #51195, #51194 |
| 3 |
Make Build Testing |
✅ |
Build succeeded |
| 4 |
Playwright Testing |
❌ |
Version mismatch — skill needs playwright-cli install --skills |
| 5 |
Tavily Web Search Testing |
✅ |
5 results returned |
| 6 |
File Writing Testing |
✅ |
/tmp/gh-aw/agent/smoke-test-claude-31220026226.txt created |
| 7 |
Bash Tool Testing |
✅ |
File contents verified via cat |
| 8 |
Discussion Interaction Testing |
✅ |
Discussion #335 found; comment added |
| 9 |
Agenticworkflows MCP Testing |
✅ |
smoke-claude active; smoke-claude-on-copilot status=Unknown |
| 10 |
Slack Script Safe Output |
✅ |
Posted to #smoke-tests |
| 11 |
Code Scanning Alert Safe Output |
✅ |
Dummy warning alert created |
| 12 |
Check Run Safe Output |
✅ |
Check run created |
| 13 |
Update PR Testing |
✅ |
PR #51133 body appended |
| 14 |
PR Review Comment Testing |
✅ |
2 comments on PR #51133 |
| 15 |
Submit PR Review Testing |
✅ |
Review submitted |
| 16 |
Resolve Review Thread Testing |
✅ |
Thread resolved |
| 17 |
Add Reviewer Testing |
✅ |
copilot added |
| 18 |
Push to PR Branch Testing |
✅ |
Smoke file pushed to branch |
| 19 |
Close PR Testing |
⚠️ |
Skipped — no safe test PR to close |
Overall Status: PARTIAL
⚠️ Playwright (#4) failed due to skill version mismatch. Test #19 skipped (no safe PR to close).
All other tests passed ✅.
Error Details
💥 [THE END] — Illustrated by Smoke Claude · sonnet46 · 58.8 AIC · ⌖ 19.5 AIC · ⊞ 6.3K · ◷
Comment /smoke-claude to run again
Smoke Test: Claude Engine — Run 31220026226
Run URL: https://github.com/github/gh-aw/actions/runs/31220026226
Timestamp: 2026-08-07T21:31 UTC
PR Used for Review Tests: #51133 "Harden safe-output field validation"
Test Results
playwright-cli install --skills/tmp/gh-aw/agent/smoke-test-claude-31220026226.txtcreatedcatsmoke-claudeactive;smoke-claude-on-copilotstatus=UnknowncopilotaddedOverall Status: PARTIAL
Error Details
playwright-cli browser_snapshotfailed with "skill does not match tool version" — requiresplaywright-cli install --skills