You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A Claude Code user who avoids all Copilot products can onboard gh-aw end-to-end: prerequisites list Anthropic as a first-class account, and the quick-start ships a dedicated Claude auth step (quick-start.mdx:98-100). No critical blockers. The persistent friction is that Copilot is the silent default engine and the only engine with a PAT-free/org-billing auth path — a Claude user must know to opt out and always provide an API key. Score: 7.5/10, stable across 20 daily runs.
Severity Findings (Critical → Major → Minor)
Critical Blockers: None. Claude has account, secret, tool, and example coverage sufficient to complete onboarding.
Major Obstacles
No PAT-free / OAuth path for Claude. Copilot offers tokenless org billing via permissions.copilot-requests: write (cli.md:171); Claude's only documented route is a console ANTHROPIC_API_KEY (quick-start.mdx:98-100). A Claude Pro/Max subscriber has no surfaced way to reuse a subscription token — API key is mandatory. Fix: add a one-line note in the Claude tab pointing to keyless/WIF alternatives and clarifying subscription tokens are not accepted.
Silent Copilot default. If engine: is omitted (or later removed) the runtime defaults to Copilot (quick-start.mdx:72-75). --engine claude pre-selects Claude but is not surfaced in the main add flow. A Claude user who skips the flag silently gets Copilot artifacts. Fix: surface --engine claude in the primary quick-start command, not only the wizard prompt.
Uneven secret callouts. Quick-start gives detailed NOTE callouts for Copilot + Anthropic; Codex/Gemini are thinner (quick-start.mdx:81,98-112). Low impact for the Claude persona but signals Copilot-first authoring.
Minor Confusion
Copilot-first nudge "if you already have Copilot, start there — no extra account setup" (quick-start.mdx:30); no "why Claude vs Copilot" guidance.
crush appears in the secrets bootstrap --engine list (cli.md:258) with no documented secret or setup.
Custom engine has 1 example (shared/genaiscript.md); no default Claude model/version documented.
Parity: Copilot dominates examples ~2.1× (124 vs 59) and is the default, but Claude is second overall and actually leads the inline engine: claude string form — strong real-world Claude representation. Tools: 14 total, 13 engine-agnostic, 0 Copilot-only, 0 Claude-only. Only web-search is engine-dependent (Codex disabled by default, tools.md:65-67). No tool is inaccessible to Claude users — the single most important adoption positive.
No documented Claude org-billing/tokenless alternative in the six core files — only Copilot has one (cli.md:171).
crush in bootstrap list (cli.md:258) — no secret name or setup anywhere.
GH_AW_PROJECT_GITHUB_TOKEN (cli.md:865) needed for project commands but absent from Prerequisites (quick-start.mdx:30-35).
Anthropic Bedrock/Vertex/self-hosted gateways not mentioned; only console.anthropic.com key (quick-start.mdx:99).
Note: this run's doc-reader scoped to 6 core files and did not re-read auth.mdx, where prior runs found WIF keyless auth (auth.mdx:207-271) and the CLAUDE_CODE_OAUTH_TOKEN-unsupported caveat. Those paths exist but remain unsurfaced in quick-start.
Recommended Actions
Priority 1 — surface Claude auth alternatives. In the Claude quick-start tab, add one line: subscription/OAuth tokens are not accepted, and link the keyless/WIF option so Claude Pro/Max users aren't stuck assuming an API key is the only path.
Priority 2 — make the engine choice explicit. Put --engine claude in the headline quick-start command and add a visible "engine omitted → defaults to Copilot" warning at quick-start.mdx:72-75.
Priority 3 — polish. Equalize Codex/Gemini secret callouts, document a default Claude model, and either document or drop crush from the bootstrap list. Consider a short "which engine should I pick?" section to offset the Copilot-first framing.
Trend: Stable vs 2026-07-05 — same 7.5 score, 0 critical, identical 3 major gaps for the 20th consecutive run. Claude remains a first-class, fully-onboardable engine; the API-key-only auth path is the single most persona-relevant obstacle.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Executive Summary
A Claude Code user who avoids all Copilot products can onboard gh-aw end-to-end: prerequisites list Anthropic as a first-class account, and the quick-start ships a dedicated Claude auth step (
quick-start.mdx:98-100). No critical blockers. The persistent friction is that Copilot is the silent default engine and the only engine with a PAT-free/org-billing auth path — a Claude user must know to opt out and always provide an API key. Score: 7.5/10, stable across 20 daily runs.Severity Findings (Critical → Major → Minor)
Critical Blockers: None. Claude has account, secret, tool, and example coverage sufficient to complete onboarding.
Major Obstacles
permissions.copilot-requests: write(cli.md:171); Claude's only documented route is a consoleANTHROPIC_API_KEY(quick-start.mdx:98-100). A Claude Pro/Max subscriber has no surfaced way to reuse a subscription token — API key is mandatory. Fix: add a one-line note in the Claude tab pointing to keyless/WIF alternatives and clarifying subscription tokens are not accepted.engine:is omitted (or later removed) the runtime defaults to Copilot (quick-start.mdx:72-75).--engine claudepre-selects Claude but is not surfaced in the main add flow. A Claude user who skips the flag silently gets Copilot artifacts. Fix: surface--engine claudein the primary quick-start command, not only the wizard prompt.quick-start.mdx:81,98-112). Low impact for the Claude persona but signals Copilot-first authoring.Minor Confusion
quick-start.mdx:30); no "why Claude vs Copilot" guidance.crushappears in thesecrets bootstrap --enginelist (cli.md:258) with no documented secret or setup.shared/genaiscript.md); no default Claude model/version documented.Engine & Tool Matrix
.github/workflows)COPILOT_GITHUB_TOKENor tokenlesscopilot-requests: writeANTHROPIC_API_KEYonlyOPENAI_API_KEY/CODEX_API_KEYParity: Copilot dominates examples ~2.1× (124 vs 59) and is the default, but Claude is second overall and actually leads the inline
engine: claudestring form — strong real-world Claude representation. Tools: 14 total, 13 engine-agnostic, 0 Copilot-only, 0 Claude-only. Onlyweb-searchis engine-dependent (Codex disabled by default,tools.md:65-67). No tool is inaccessible to Claude users — the single most important adoption positive.Auth Gaps
Required secrets & missing instructions
COPILOT_GITHUB_TOKEN(Copilot Requests: Read)copilot-requests: writeANTHROPIC_API_KEYOPENAI_API_KEY/CODEX_API_KEYGEMINI_API_KEYGaps (from
doc-reader.auth_gaps_or_missing_instructions):cli.md:171).crushin bootstrap list (cli.md:258) — no secret name or setup anywhere.GH_AW_PROJECT_GITHUB_TOKEN(cli.md:865) needed for project commands but absent from Prerequisites (quick-start.mdx:30-35).console.anthropic.comkey (quick-start.mdx:99).Note: this run's
doc-readerscoped to 6 core files and did not re-readauth.mdx, where prior runs found WIF keyless auth (auth.mdx:207-271) and theCLAUDE_CODE_OAUTH_TOKEN-unsupported caveat. Those paths exist but remain unsurfaced in quick-start.Recommended Actions
Priority 1 — surface Claude auth alternatives. In the Claude quick-start tab, add one line: subscription/OAuth tokens are not accepted, and link the keyless/WIF option so Claude Pro/Max users aren't stuck assuming an API key is the only path.
Priority 2 — make the engine choice explicit. Put
--engine claudein the headline quick-start command and add a visible "engine omitted → defaults to Copilot" warning atquick-start.mdx:72-75.Priority 3 — polish. Equalize Codex/Gemini secret callouts, document a default Claude model, and either document or drop
crushfrom the bootstrap list. Consider a short "which engine should I pick?" section to offset the Copilot-first framing.Trend: Stable vs 2026-07-05 — same 7.5 score, 0 critical, identical 3 major gaps for the 20th consecutive run. Claude remains a first-class, fully-onboardable engine; the API-key-only auth path is the single most persona-relevant obstacle.
References:
Beta Was this translation helpful? Give feedback.
All reactions