Automated smoke test run for Claude engine validation.
Test Summary
#
Test
Status
1
GitHub MCP — last 2 merged PRs
✅
2
mcpscripts-gh CLI — query 2 PRs
✅
3
Serena MCP — activate + find symbols
✅
4
Make Build
✅
5
Playwright — navigate to GitHub
✅
6
Tavily web search
✅
7
File writing
✅
8
Bash tool validation
✅
9
Discussion interaction
✅
10
Agentic Workflows MCP status
✅
11
Slack safe output
✅
12
Code scanning alert
✅
13
Update PR body
✅
14
PR review comments (×2)
✅
15
Submit PR review
✅
16
Resolve review thread
⚠️ Skipped — no unresolved threads visible via API
17
Add reviewer
✅
18
Push to PR branch
✅
19
Close PR
⚠️ Skipped — no safe test PR to close
Overall Status: PARTIAL (2 skipped, 17 passed)
### Test Details
Test 1: GitHub MCP
Retrieved last 2 merged PRs:
Test 2: mcpscripts-gh CLI
[{"author" :{"login" :" app/copilot-swe-agent" "number" :30437 ,"title" :" [WIP] Fix permissions for minted App token" "author" :{"login" :" app/copilot-swe-agent" "number" :30433 ,"title" :" fix: replace APM with gh skill install" Test 3: Serena MCP
Activated project at /home/runner/work/gh-aw/gh-aw (Go). Found 3+ symbols:
ValidatePathWithinBase (pkg/fileutil/fileutil.go)(*Compiler).CompileWorkflow (pkg/workflow/compiler.go)CompileWorkflows (pkg/cli/compile_orchestrator.go)
Test 4: Make Build
go build -ldflags "-s -w -X main.version=v0.71.4-93-g19ac811a4" -o gh-aw ./cmd/gh-aw
Test 5: Playwright
Page title: GitHub · Change is constant. GitHub keeps you ahead. · GitHub ✅
Test 6: Tavily
Search for "GitHub Agentic Workflows" — 3 results from githubnext.com, github.blog, itnext.io
Test 7-8: File Writing / Bash
Smoke test passed for Claude at Tue May 5 20:10:44 UTC 2026
Test 9: Discussion Interaction
Retrieved discussion #30436 ("copilot was here"), added comic-book comment ✅
Test 10: Agentic Workflows MCP
workflow: smoke-claude | engine: claude | compiled: Yes | status: active
triggers: pull_request(labeled:smoke), reaction:heart, status-comment
Status file: /tmp/gh-aw/agent/smoke-claude-status-25399543957.txt
Tests 11-12: Slack + Code Scanning
Both safe output tool calls succeeded ✅
Tests #13 -19: PR Review Safe Outputs
Used PR #30433 ("fix: replace APM with gh skill install in mattpocock-skills-reviewer workflow")
Metadata
Firewall blocked 6 domains
The following domains were blocked by the firewall during workflow execution:
accounts.google.comandroid.clients.google.comclients2.google.comcontentautofill.googleapis.comsafebrowsingohttpgateway.googleapis.comwww.google.com
To allow these domains, add them to the network.allowed list in your workflow frontmatter:
network :
allowed :
- defaults
- " accounts.google.com" " android.clients.google.com" " clients2.google.com" " contentautofill.googleapis.com" " safebrowsingohttpgateway.googleapis.com" " www.google.com" See Network Configuration for more information.
💥 [THE END] — Illustrated by Smoke Claude · ● 270.7K · ◷
Automated smoke test run for Claude engine validation.
Test Summary
Overall Status: PARTIAL (2 skipped, 17 passed)
### Test Details
Test 1: GitHub MCP
Retrieved last 2 merged PRs:
template_branch.cjsintegration gaps #30425: "Fix CJS shard failures caused bytemplate_branch.cjsintegration gaps"Test 2: mcpscripts-gh CLI
[{"author":{"login":"app/copilot-swe-agent"},"number":30437,"title":"[WIP] Fix permissions for minted App token"},{"author":{"login":"app/copilot-swe-agent"},"number":30433,"title":"fix: replace APM with gh skill install"}]Test 3: Serena MCP
Activated project at
/home/runner/work/gh-aw/gh-aw(Go). Found 3+ symbols:ValidatePathWithinBase(pkg/fileutil/fileutil.go)(*Compiler).CompileWorkflow(pkg/workflow/compiler.go)CompileWorkflows(pkg/cli/compile_orchestrator.go)Test 4: Make Build
Test 5: Playwright
Page title:
GitHub · Change is constant. GitHub keeps you ahead. · GitHub✅Test 6: Tavily
Search for "GitHub Agentic Workflows" — 3 results from githubnext.com, github.blog, itnext.io
Test 7-8: File Writing / Bash
Test 9: Discussion Interaction
Retrieved discussion #30436 ("copilot was here"), added comic-book comment ✅
Test 10: Agentic Workflows MCP
Status file:
/tmp/gh-aw/agent/smoke-claude-status-25399543957.txtTests 11-12: Slack + Code Scanning
Both safe output tool calls succeeded ✅
Tests #13-19: PR Review Safe Outputs
Used PR #30433 ("fix: replace APM with gh skill install in mattpocock-skills-reviewer workflow")
.github/workflows/mattpocock-skills-reviewer.md✅copilotas reviewer ✅smoke-test-files/smoke-claude-push-test.mdtocopilot/fix-github-actions-agent-failure✅Metadata
Warning
Firewall blocked 6 domains
The following domains were blocked by the firewall during workflow execution:
accounts.google.comandroid.clients.google.comclients2.google.comcontentautofill.googleapis.comsafebrowsingohttpgateway.googleapis.comwww.google.comSee Network Configuration for more information.