Skip to content

[WIP] docs: clarifications and review on token efficieny#2165

Draft
mnkiefer wants to merge 1 commit intotoken-efficiency-paperfrom
mnkiefer/token-efficienty-review
Draft

[WIP] docs: clarifications and review on token efficieny#2165
mnkiefer wants to merge 1 commit intotoken-efficiency-paperfrom
mnkiefer/token-efficienty-review

Conversation

@mnkiefer
Copy link
Copy Markdown

No description provided.

@github-actions
Copy link
Copy Markdown
Contributor

🔥 Smoke Test: Copilot BYOK (Offline) Mode

Test Result
GitHub MCP (list PRs) ⚠️ gh CLI unavailable in sandbox
GitHub.com connectivity ⚠️ Pre-step output not resolved
File write/read /tmp/gh-aw/agent/smoke-test-copilot-byok-24834303928.txt exists
BYOK inference (agent → api-proxy → api.githubcopilot.com)

Running in BYOK offline mode (COPILOT_OFFLINE=true) via api-proxy → api.githubcopilot.com.

Overall: PASS

PR #2165 — author @mnkiefer

🔑 BYOK report filed by Smoke Copilot BYOK

@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test Summary

  • PR titles: (unable to fetch due to GH API 404)
  • File write: ✅
  • File readback: ✅
  • Build: ✅
  • Overall status: PASS

All tests except PR listing passed. Label will be set.

Warning

⚠️ Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • models.dev

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "models.dev"

See Network Configuration for more information.

🌐 Transmitted by Smoke OpenCode

@github-actions
Copy link
Copy Markdown
Contributor

🔬 Smoke Test Results

Test Result
GitHub MCP (github-list_pull_requests) ❌ GraphQL/MCP unavailable (REST works; latest merged PR: #2162)
GitHub.com connectivity ✅ HTTP 200
File write/read ❌ Pre-step template vars unresolved; no file found

Overall: FAIL

@mnkiefer — pre-step outputs (SMOKE_HTTP_CODE, SMOKE_FILE_PATH, etc.) were not interpolated before agent execution, so file and HTTP code tests could not be fully validated from pre-fetched data.

📰 BREAKING: Report filed by Smoke Copilot

@github-actions

This comment has been minimized.

@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test: GitHub Actions Services Connectivity

Check Result
Redis PING (host.docker.internal:6379) ❌ Failed — redis-cli unavailable; raw TCP connection timed out
PostgreSQL pg_isready (host.docker.internal:5432) accepting connections
PostgreSQL SELECT 1 (smoketest db, user postgres) ✅ Returned 1

2/3 checks passed. Redis connectivity failed (tool not installed, TCP connection timed out), so the smoke-services label was not applied.

🔌 Service connectivity validated by Smoke Services

@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test Results:

  • ❌ GitHub MCP: gh CLI authentication unavailable (expected in sandbox)
  • ✅ Playwright: Page title verified (contains "GitHub")
  • ✅ File Writing: Test file created and verified
  • ✅ Bash Tool: File read back successfully

Overall: CONDITIONAL PASS (MCP limitation, core tests pass)

💥 [THE END] — Illustrated by Smoke Claude

@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test Results
PR titles: docs: clarifications and review on token efficieny; fix: correct firewall issue dispatcher tracking issue link format
GitHub MCP (last 2 merged PRs): ✅
SafeInputs GH CLI query (2 PRs): ❌ (tool unavailable in this run)
Playwright github.com title contains "GitHub": ✅
Tavily web search returned >=1 result: ❌ (tool unavailable in this run)
File write to /tmp/gh-aw/agent: ✅
Bash cat file verification: ✅
Discussion oracle comment posted: ✅
Build (npm ci && npm run build): ✅
Overall status: FAIL

Warning

⚠️ Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • registry.npmjs.org

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "registry.npmjs.org"

See Network Configuration for more information.

🔮 The oracle has spoken through Smoke Codex

@mnkiefer mnkiefer changed the title docs: clarifications and review on token efficieny [WIP] docs: clarifications and review on token efficieny Apr 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant