Smoke Test: Claude - 27067065704

[github-actions]

Smoke Test: Claude Engine — Run 27067065704

Overall status: FAIL (Serena MCP server unavailable in environment)

Run URL: https://github.com/github/gh-aw/actions/runs/27067065704
Timestamp: 2026-06-06 16:10 UTC
PR used for review tests: #37338

Core Tests

#	Test	Result
1	GitHub MCP (review last 2 merged PRs: #37340, #37332)	✅
2	GH CLI (gh pr list)	✅
3	Serena MCP (activate_project / find_symbol)	❌ Server not available in this environment (not in MCP manifest; no serena CLI)
4	Make build	✅
5	Playwright (title contains "GitHub")	✅
6	Tavily web search	✅ (5 results)
7	File writing	✅
8	Bash tool	✅
9	Discussion interaction (#335)	✅
10	Agentic Workflows MCP (status)	✅
11	Slack safe output	✅
12	Code scanning alert	✅
13	Check run	✅

PR Review Tests (PR #37338)

#	Test	Result
14	Update PR body	✅
15	PR review comments (x2)	✅
16	Submit PR review	✅
17	Resolve review thread	⚠️ Skipped (no pre-existing unresolved threads; new threads not yet applied)
18	Add reviewer	✅
19	Push to PR branch	✅
20	Close PR	⚠️ Skipped (no safe test/bot PR to close)

Error Details

• Test 3 (Serena): The Serena MCP server is not present in the MCP CLI manifest (only agenticworkflows, mcpscripts, safeoutputs, tavily are available) and no serena binary exists on PATH. activate_project and find_symbol could not be invoked. Reported via missing_tool.

Warning

Firewall blocked 6 domains

The following domains were blocked by the firewall during workflow execution:

• accounts.google.com
• android.clients.google.com
• clients2.google.com
• contentautofill.googleapis.com
• safebrowsingohttpgateway.googleapis.com
• www.google.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "accounts.google.com"
    - "android.clients.google.com"
    - "clients2.google.com"
    - "contentautofill.googleapis.com"
    - "safebrowsingohttpgateway.googleapis.com"
    - "www.google.com"

See Network Configuration for more information.

💥 [THE END] — Illustrated by Smoke Claude · opus48 249.2K · 74.8 AIC · ⌖ 30.5 AIC · ◷

• expires on Jun 6, 2026, 6:13 PM UTC

[github-actions]

This issue was automatically closed because it expired on 2026-06-06T18:13:32.507Z.

Closed by Workflow