Smoke Test: Claude - 24941211951

[github-actions]

Summary

Smoke test run for Claude engine completed on 2026-04-25. Overall status: PARTIAL (1 failure, 2 skipped).

Run URL: https://github.com/github/gh-aw/actions/runs/24941211951
Timestamp: 2026-04-25T21:38 UTC
PR used for review tests: #28496 (already merged)

---

Test Results

#	Test	Result	Notes
1	GitHub MCP Testing	✅	Reviewed PRs #28496 and #28494 (last 2 merged)
2	MCP Scripts GH CLI Testing	✅	Got PRs #28502, #28501 via gh CLI
3	Serena MCP Testing	✅	Project activated; 10+ symbols found in gemini_engine.go
4	Make Build Testing	✅	make build succeeded, binary built
5	Playwright Testing	✅	github.com loaded, title contains "GitHub"
6	Tavily Web Search Testing	✅	3 results for "GitHub Agentic Workflows"
7	File Writing Testing	✅	/tmp/gh-aw/agent/smoke-test-claude-24941211951.txt created
8	Bash Tool Testing	✅	File content verified via cat
9	Discussion Interaction Testing	✅	Comic-book comment added to discussion #28504
10	Agentic Workflows MCP Testing	❌	Error: "failed to get workflow statuses"
11	Slack Safe Output Testing	✅	Message posted to #smoke-tests
12	Code Scanning Alert Testing	✅	Dummy warning alert created for README.md:1
13	Update PR Testing	✅	PR #28496 body updated with append
14	PR Review Comment Testing	✅	2 comments added to gemini_engine.go lines 169, 177
15	Submit PR Review Testing	✅	COMMENT review submitted
16	Resolve Review Thread Testing	⚠️	Skipped — PR data integrity-filtered, cannot read threads
17	Add Reviewer Testing	✅	copilot added as reviewer
18	Push to PR Branch Testing	✅	smoke-test-files/smoke-claude-push-test.md pushed
19	Close PR Testing	⚠️	Skipped — no safe test PR to close

---

Failure Details

Test #10 — Agentic Workflows MCP Status:

• Error: MCP error -32603: calling "tools/call": failed to get workflow statuses
• Both attempts returned same error
• Status file written to /tmp/gh-aw/agent/smoke-claude-status-24941211951.txt

Skipped Details

Test #16 — Resolve Review Thread:
PR #28496 data is filtered by integrity policy (integrity below "approved"), preventing reading of review thread IDs via GitHub MCP.

Test #19 — Close PR:
No test/bot PR available to safely close.

---

References:

• §24941211951 — This smoke test run

Note

🔒 Integrity filter blocked 1 item

The following item was blocked because it doesn't meet the GitHub integrity level.

• fix: add --skip-trust to Gemini CLI command to prevent yolo override in AWF sandbox #28496 pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".

To allow these resources, lower min-integrity in your GitHub frontmatter:

tools:
  github:
    min-integrity: approved  # merged | approved | unapproved | none

💥 [THE END] — Illustrated by Smoke Claude · ● 178.1K · ◷

• expires on Apr 25, 2026, 11:44 PM UTC

[github-actions]

This issue was automatically closed because it expired on 2026-04-25T23:44:48.246Z.

Closed by Workflow