[docs-noob-tester] 📚 Documentation Noob Test Report - 2026-09-30

[github-actions[bot]]

Summary

• Date: 2026-09-30
• Pages visited: /gh-aw/, /gh-aw/setup/quick-start/, /gh-aw/setup/cli/
• Impression: A new user gets a clear pitch and a good "day-one commands" table. The Quick Start is mostly well structured but assumes some knowledge, and the home page is dense.

Critical Issues Found

None found. All 3 pages loaded and rendered.

Confusing Areas

1. Quick Start heading duplication: The page renders a stray "YAML frontmatter / Section titled “YAML frontmatter”" heading right after the title, before the intro paragraph. It looks like a heading mistake and the section is not about frontmatter.
2. Jargon on first use: "frontmatter", "lock file", "safe outputs", "engine", "AIC" and "microVM" are used without a link or short definition. Frontmatter is defined, but the others are not.
3. Home page density: Many sections (guardrails, cost, OpenTelemetry, ARC runners) appear before the first example. A beginner has to scroll a long way to see what a workflow looks like.
4. Prerequisites: Says "GitHub CLI v2.0.0+" and "Windows with WSL". It is unclear how to pick an AI engine, or what the secret/token setup involves, before running add-wizard.
5. add-wizard githubnext/agentics/repo-status: The <owner>/<repo>/<workflow> format is explained, but a user doesn't know the wizard will push or open a PR to their repo until later in the text.
6. CLI page: The version-pinning examples (v0.1.0, v0.2.0) look stale next to the current release. The Windows PowerShell installer sits next to the Linux one without OS labels.
7. Typo on home page: "in you organization" (should be "your").

What Worked Well

• The home page tagline and "Get Started with CLI" button are easy to find.
• The Quick Start states time (10 min), prerequisites and each step with copy-pasteable commands.
• The CLI page opens with a "Day-one commands" table with a "When to use" column, and a tip that lets beginners skip advanced content.
• The install fallback (curl script) is helpful.

Recommendations

• Quick wins: fix the stray heading and the "you organization" typo; add a glossary link for key terms; update the pinned-version examples.
• Medium: put a minimal workflow example higher on the home page; add OS tabs on install instructions.
• Longer term: add a "what will happen to my repo" summary before add-wizard, plus a troubleshooting section for common auth errors.

Screenshots

📎 home.png: https://github.com/github/gh-aw/blob/assets/Documentation-Noob-Tester/bfe04de845f8b015432bec87bd1f0657d5bc8682848a2ebc4b04bce95c5fd99f.png?raw=true
📎 quick.png: https://github.com/github/gh-aw/blob/assets/Documentation-Noob-Tester/4f90d1d5a399383cd831f7377522541b41f1817817b1fa36325c2eb63e7ac7cb.png?raw=true
📎 cli.png: https://github.com/github/gh-aw/blob/assets/Documentation-Noob-Tester/cd4bc1143129cfcccf4a2a403be9f578b46c231bd1a9771e0ac645e436af934f.png?raw=true

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• clients2.google.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "clients2.google.com"

See Network Configuration for more information.

Generated by 📝 Documentation Noob Tester · copilot · auto · 18.5 AIC · ⌖ 5.99 AIC · ⊞ 10.7K · ◷

• expires on Sep 30, 2026, 7:58 PM UTC-08:00

[github-actions[bot]]

This discussion has been marked as outdated by Documentation Noob Tester.

A newer discussion is available at Discussion #64676.