Smoke Test: Claude - 24014480491

[github-actions]

Overview

Automated smoke test run for the Claude engine — verifying all MCP tools, safe outputs, and integrations.

• Run: §24014480491
• Timestamp: 2026-04-06T01:02:48Z
• PR used for review tests: Add report_incomplete safe output type to prevent tool-failure comments from being classified as successful runs #24796 (copilot/fix-gh-aw-verdict-handling)
• Overall Status: PARTIAL (Tavily rate-limited, Playwright permission error on log file)

---

Test Results

#	Test	Result
1	GitHub MCP — last 2 merged PRs	✅ PR #24786 (feat otel) & #24785 (fix SEC-004)
2	mcpscripts-gh CLI — list 2 PRs	✅ #24796 & #24792 returned
3	Serena MCP — activate + find ≥3 symbols	✅ 8 Config symbols found across pkg/
4	Make Build	✅ go build succeeded, binary produced
5	Playwright — GitHub page title	✅ Title contains "GitHub" (via browser_run_code)
6	Tavily Web Search	❌ Rate-limited (HTTP 429) on all 3 attempts
7	File Write — /tmp/gh-aw/agent/smoke-test-claude-24014480491.txt	✅ Created
8	Bash — verify file creation	✅ File content read back successfully
9	Discussion comment (#24794)	✅ Comic-book style comment added
10	Agentic Workflows MCP — smoke-claude status	✅ active, compiled, every 12h schedule
11	Slack safe output (#smoke-tests)	✅ Message posted
12	Code Scanning Alert (warning, README.md:1)	✅ Created
13	Update PR body (append)	✅ PR #24796 body updated
14	PR Review Comments (2 inline)	✅ 2 comments on smoke-test-files/smoke-claude-push-test.md:1
15	Submit PR Review (COMMENT)	✅ Review submitted
16	Resolve Review Thread	⚠️ Skipped — no existing threads found
17	Add Reviewer (copilot)	✅ Reviewer added
18	Push to PR Branch	✅ smoke-test-files/smoke-claude-push-test.md pushed
19	Close PR	⚠️ Skipped — no safe test PR to close

---

Details

Test #3 — Serena Symbols Found

• Config struct in pkg/agentdrain/types.go
• Snapshot/Config in pkg/agentdrain/persist.go
• MCPRegistryServerForProcessing/Config in pkg/cli/mcp_registry.go
• SandboxConfig/Config in pkg/workflow/sandbox.go
• AgentSandboxConfig/Config in pkg/workflow/sandbox.go
• EngineConfig/Config in pkg/workflow/engine.go
• ResolvedEngineTarget/Config in pkg/workflow/engine_definition.go
• MCPServerInfo/Config in pkg/parser/mcp.go

Test #10 — smoke-claude Workflow Status

Workflow: smoke-claude
Engine: claude
Compiled: Yes
Status: active
Schedule: every 12h
Triggers: pull_request (labeled "smoke"), reaction: heart, workflow_dispatch

Test #6 — Tavily Failure

All 3 Tavily search attempts returned HTTP 429 (rate limited). API key may be exhausted for this session.

---

Summary

• Passed: 15/19 tests ✅
• Failed: 1/19 tests ❌ (Tavily rate-limited)
• Skipped: 2/19 tests ⚠️ (no threads to resolve, no safe PR to close)
• Overall: PARTIAL

Note

🔒 Integrity filter blocked 1 item

The following item were blocked because they don't meet the GitHub integrity level.

• Surface pre-activation denial reason in job summary #24792 pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".

To allow these resources, lower min-integrity in your GitHub frontmatter:

tools:
  github:
    min-integrity: approved  # merged | approved | unapproved | none

💥 [THE END] — Illustrated by Smoke Claude · ● 336.6K · ◷

• expires on Apr 6, 2026, 3:09 AM UTC

[github-actions]

This issue is being closed as outdated. A newer issue has been created: #24810

View newer issue

---

This action was performed automatically by the Smoke Claude workflow.