You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
gh-aw is genuinely multi-engine and a Claude Code user can onboard: Claude is a first-class prerequisite, the quick-start has a dedicated ANTHROPIC_API_KEY setup block, all tools are engine-agnostic, and Claude is second-most-used across 258 workflows (62 explicit files). Score: 7.5/10, 0 critical blockers — unchanged for 17 consecutive daily runs. The single most persona-relevant obstacle remains that CLAUDE_CODE_OAUTH_TOKEN is silently ignored — Claude Pro/Max/Teams subscribers must obtain a separate ANTHROPIC_API_KEY, and that caveat lives only in auth.mdx, never in the quick-start a new user actually reads.
Severity Findings
🚫 Critical Blockers — none this run
No documentation gap fully prevents a Claude Code user from adopting gh-aw. Claude is a supported engine with quick-start auth instructions.
⚠️ Major Obstacles (3, all persistent)
CLAUDE_CODE_OAUTH_TOKEN unsupported / silently ignored — only ANTHROPIC_API_KEY (or WIF keyless) works. Caveat is at auth.mdx:199-201 but absent from quick-start.mdx. A Claude Code user with a Pro/Max/Teams subscription reasonably expects their existing OAuth login to work; it doesn't, and the quick-start never says so. → Add a one-line NOTE to the Anthropic setup step: "Claude subscription OAuth tokens are not supported — create an API key."
gh aw init defaults to Copilot artifacts — --engine claude is documented at cli.md:146 (# Skip Copilot-specific artifacts) but the quick-start add flow never surfaces the flag. → Show gh aw init --engine claude in the quick-start Step 2 example.
Omitting engine: silently defaults to Copilot — 23 of 258 workflow files rely on this implicit default. Quick-start spells out Copilot + Anthropic + Codex secrets in detail, but Gemini is a listed prerequisite (quick-start.mdx:29) with no dedicated auth block. → State the default explicitly and add a Gemini secret callout.
💡 Minor Confusion (2)
Copilot-first framing — quick-start.mdx:29: "If you already have GitHub Copilot, start there — it requires no extra account setup." No "why choose Claude vs Copilot" guidance anywhere. → Add a short engine-selection paragraph.
WIF keyless auth not surfaced — Anthropic github-oidc federation (auth.mdx:207-271) is the modern PAT-free path for Claude but never appears in the quick-start. Custom engine has just 1 example (design-decision-gate.md) and no auth section.
Tools (reference/tools.md): 12 documented — 11 engine-agnostic (edit, github, bash, web-fetch, playwright, cache-memory, repo-memory, qmd, agentic-workflows, cli-proxy, mcp-servers), 0 Copilot-only / Claude-only / Codex-only, 1 unclear (web-search: engine-dependent, disabled-by-default for Codex). No tool is inaccessible to a Claude user.
Parity observation: Claude leads the inline-string engine: claude form; Copilot dominates the object form. Effective Claude:Copilot ratio ≈ 1:2.47, but near-parity in analysis/review/safe-output workflow families — good adoption signal.
Auth Gaps (from quick-start.mdx, per auth-doc-extractor)
CLAUDE_CODE_OAUTH_TOKEN not supported — documented auth.mdx:199-201, missing from quick-start. (highest impact for this persona)
Anthropic WIF keyless auth (auth.mdx:207-271) not surfaced in quick-start.
GH_AW_GITHUB_TOKEN fallback (auth.mdx:151-178) for cross-repo writes not mentioned.
Recommended copilot-requests: write PAT-free path (auth.mdx:92-116) shown only in tips, not the main flow.
Custom engine has no auth documentation in either quick-start or auth.mdx.
Recommended Actions
Priority 1 (close the persona blocker): Add a NOTE to the quick-start Anthropic step — Claude subscription OAuth tokens are unsupported, use an API key or WIF. This single edit resolves the most-cited gap across 17 runs.
Priority 2: Surface gh aw init --engine claude in the quick-start add flow; state the implicit-Copilot default explicitly; add a Gemini secret callout.
Priority 3: Add an "engine selection / why Claude vs Copilot" paragraph; surface WIF keyless auth and a custom-engine auth example in the quick-start.
17-run trend: score flat at 7.5, 0 critical. The same 3 major gaps have persisted unchanged — these are documentation edits, not code work, and Priority 1 is a one-line fix.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Executive Summary
gh-aw is genuinely multi-engine and a Claude Code user can onboard: Claude is a first-class prerequisite, the quick-start has a dedicated
ANTHROPIC_API_KEYsetup block, all tools are engine-agnostic, and Claude is second-most-used across 258 workflows (62 explicit files). Score: 7.5/10, 0 critical blockers — unchanged for 17 consecutive daily runs. The single most persona-relevant obstacle remains thatCLAUDE_CODE_OAUTH_TOKENis silently ignored — Claude Pro/Max/Teams subscribers must obtain a separateANTHROPIC_API_KEY, and that caveat lives only inauth.mdx, never in the quick-start a new user actually reads.Severity Findings
🚫 Critical Blockers — none this run
No documentation gap fully prevents a Claude Code user from adopting gh-aw. Claude is a supported engine with quick-start auth instructions.
CLAUDE_CODE_OAUTH_TOKENunsupported / silently ignored — onlyANTHROPIC_API_KEY(or WIF keyless) works. Caveat is atauth.mdx:199-201but absent fromquick-start.mdx. A Claude Code user with a Pro/Max/Teams subscription reasonably expects their existing OAuth login to work; it doesn't, and the quick-start never says so. → Add a one-line NOTE to the Anthropic setup step: "Claude subscription OAuth tokens are not supported — create an API key."gh aw initdefaults to Copilot artifacts —--engine claudeis documented atcli.md:146(# Skip Copilot-specific artifacts) but the quick-start add flow never surfaces the flag. → Showgh aw init --engine claudein the quick-start Step 2 example.engine:silently defaults to Copilot — 23 of 258 workflow files rely on this implicit default. Quick-start spells out Copilot + Anthropic + Codex secrets in detail, but Gemini is a listed prerequisite (quick-start.mdx:29) with no dedicated auth block. → State the default explicitly and add a Gemini secret callout.💡 Minor Confusion (2)
quick-start.mdx:29: "If you already have GitHub Copilot, start there — it requires no extra account setup." No "why choose Claude vs Copilot" guidance anywhere. → Add a short engine-selection paragraph.auth.mdx:207-271) is the modern PAT-free path for Claude but never appears in the quick-start. Custom engine has just 1 example (design-decision-gate.md) and no auth section.Engine & Tool Matrix
COPILOT_GITHUB_TOKENorcopilot-requests: write(PAT-free)ANTHROPIC_API_KEYblock (qs:86)OPENAI_API_KEY/CODEX_API_KEY(qs:96)OPENAI_BASE_URLTools (
reference/tools.md): 12 documented — 11 engine-agnostic (edit, github, bash, web-fetch, playwright, cache-memory, repo-memory, qmd, agentic-workflows, cli-proxy, mcp-servers), 0 Copilot-only / Claude-only / Codex-only, 1 unclear (web-search: engine-dependent, disabled-by-default for Codex). No tool is inaccessible to a Claude user.Parity observation: Claude leads the inline-string
engine: claudeform; Copilot dominates the object form. Effective Claude:Copilot ratio ≈ 1:2.47, but near-parity in analysis/review/safe-output workflow families — good adoption signal.Auth Gaps (from
quick-start.mdx, perauth-doc-extractor)CLAUDE_CODE_OAUTH_TOKENnot supported — documentedauth.mdx:199-201, missing from quick-start. (highest impact for this persona)auth.mdx:207-271) not surfaced in quick-start.GH_AW_GITHUB_TOKENfallback (auth.mdx:151-178) for cross-repo writes not mentioned.copilot-requests: writePAT-free path (auth.mdx:92-116) shown only in tips, not the main flow.Recommended Actions
Priority 1 (close the persona blocker): Add a NOTE to the quick-start Anthropic step — Claude subscription OAuth tokens are unsupported, use an API key or WIF. This single edit resolves the most-cited gap across 17 runs.
Priority 2: Surface
gh aw init --engine claudein the quick-start add flow; state the implicit-Copilot default explicitly; add a Gemini secret callout.Priority 3: Add an "engine selection / why Claude vs Copilot" paragraph; surface WIF keyless auth and a custom-engine auth example in the quick-start.
17-run trend: score flat at 7.5, 0 critical. The same 3 major gaps have persisted unchanged — these are documentation edits, not code work, and Priority 1 is a one-line fix.
Beta Was this translation helpful? Give feedback.
All reactions