Summary
Smoke test run for Claude engine — Run §24270838140
Overall Status: PARTIAL — Tavily Web Search tool unavailable (Test 6 ❌)
PR used for PR review tests : #25726 ([aw] Updates available)
Timestamp : 2026-04-11T00:59:00Z
Test Results
#
Test
Result
1
GitHub MCP — last 2 merged PRs
✅ PRs #25716 , #25715
2
MCP Scripts GH CLI — list 2 PRs
✅ PRs #25726 , #25721
3
Serena MCP — activate + find_symbol (≥3 symbols)
✅ 7 symbols found
4
Make Build
✅ Build succeeded
5
Playwright — GitHub page title
✅ Title contains "GitHub"
6
Tavily Web Search
❌ Tool unavailable (not in MCP tools)
7
File Writing
✅ Created /tmp/gh-aw/agent/smoke-test-claude-24270838140.txt
8
Bash Tool
✅ File read back successfully
9
Discussion Interaction
✅ Discussion #25725 found & comment added
10
Agentic Workflows MCP Status
✅ smoke-claude: active, claude engine, compiled
11
Slack Script Safe Output
✅ Message posted to #smoke-tests
12
Code Scanning Alert Safe Output
✅ Warning alert created
13
Update PR Body
✅ Appended test message to PR #25726
14
PR Review Comments
✅ 2 inline comments on PR #25726
15
Submit PR Review
✅ COMMENT review submitted
16
Resolve Review Thread
⚠️ Skipped — no existing threads
17
Add Reviewer
✅ Added copilot reviewer
18
Push to PR Branch
✅ Pushed smoke-test-files/smoke-claude-push-test.md
19
Close PR
⚠️ Skipped — no safe test PR to close
Test Details
Test 1 — GitHub MCP
Test 3 — Serena
Activated project at /home/runner/work/gh-aw/gh-aw
Found 7 symbols for pattern Run in pkg/ directory
Test 4 — Make Build
Action pins synced, scripts synced, binary built at ./gh-aw
Test 5 — Playwright
Navigated to https://github.com
Title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" ✅
Test 6 — Tavily
No Tavily MCP server in available tools list ❌
Test 10 — Agentic Workflows Status
smoke-claude: active, engine=claude, compiled=Yes
Triggers: pull_request (labeled), reaction:heart, schedule every 12h, workflow_dispatch
Written to /tmp/gh-aw/agent/smoke-claude-status-24270838140.txt
References:
Note
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools :
github :
min-integrity : approved # merged | approved | unapproved | none
💥 [THE END] — Illustrated by Smoke Claude · ● 197.1K · ◷
Summary
Smoke test run for Claude engine — Run §24270838140
Overall Status: PARTIAL — Tavily Web Search tool unavailable (Test 6 ❌)
PR used for PR review tests: #25726 (
[aw] Updates available)Timestamp: 2026-04-11T00:59:00Z
Test Results
/tmp/gh-aw/agent/smoke-test-claude-24270838140.txtcopilotreviewersmoke-test-files/smoke-claude-push-test.mdTest Details
Test 1 — GitHub MCP
Test 3 — Serena
/home/runner/work/gh-aw/gh-awRuninpkg/directoryTest 4 — Make Build
./gh-awTest 5 — Playwright
https://github.comTest 6 — Tavily
Test 10 — Agentic Workflows Status
/tmp/gh-aw/agent/smoke-claude-status-24270838140.txtReferences:
Note
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
--allow-domainsargs containing${{ }}expressions #25721pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".To allow these resources, lower
min-integrityin your GitHub frontmatter: