Skip to content

[docs] Self-healing documentation fixes from issue analysis - 2026-05-12#31604

Merged
pelikhan merged 1 commit into
mainfrom
doc-healer/max-effective-tokens-glossary-2026-05-12-256ce89bdfc9dea2
May 12, 2026
Merged

[docs] Self-healing documentation fixes from issue analysis - 2026-05-12#31604
pelikhan merged 1 commit into
mainfrom
doc-healer/max-effective-tokens-glossary-2026-05-12-256ce89bdfc9dea2

Conversation

@github-actions
Copy link
Copy Markdown
Contributor

Self-Healing Documentation Fixes

This PR was automatically created by the Daily Documentation Healer workflow.

Gaps Fixed

Root Cause

DDUw's most recent run (PR #31491) explicitly evaluated #31418 but only verified engines.md and glossary.md for the renamed max-runs field — it did not check whether the companion field max-effective-tokens had analogous glossary coverage. PR #31484 (which set the new defaults of max-runs=100 and max-effective-tokens=25000000 and added expression / shared-import support) merged at 12:03 UTC on 2026-05-11, after DDUw's run at 11:49 UTC, so DDUw could not have processed it in the same 24-hour window.

💡 DDUw Improvement Suggestions

DDUw Improvement Suggestions

  1. Sibling-field coverage check (Step 2 of daily-doc-updater.md). When DDUw processes a PR that adds or renames a top-level frontmatter field, it should look at the JSON Schema diff (pkg/parser/schemas/main_workflow_schema.json) for all sibling properties touched in the same PR, not only the renamed field. Concretely: after analyzing Refactor engine.max-runs to top-level max-runs with AWF enforcement #31418, DDUw should have noticed the schema diff also touched max-effective-tokens block alignment and confirmed it had glossary coverage equivalent to max-runs.

    Suggested wording to add under Step 2. Analyze Changes:

    For PRs that modify pkg/parser/schemas/main_workflow_schema.json, list every top-level property name in the diff. For each property, verify it has an entry in docs/src/content/docs/reference/glossary.md and that the entry mentions the default value from the schema description (look for "Defaults to ... when omitted").

  2. Same-day late-merge re-scan. PR Set frontmatter defaults and add shared import/expression support for max limits #31484 merged 14 minutes after DDUw's run. DDUw's 24-hour scanning window starts from the run time, so any PR merging in the trailing window of the same day is missed by the current day's DDUw and not re-evaluated tomorrow if the next DDUw's window begins exactly 24h later. Two options:

    • Widen the look-back window to 26 hours so adjacent runs overlap, OR
    • Re-scan only the trailing 4 hours from the previous DDUw run timestamp at the start of each run.
  3. frontmatter-full.md regeneration verification. DDUw assumed frontmatter-full.md would be "regenerated by build tooling" after the schema change. The healer verified the file does not yet include top-level max-runs or max-effective-tokens sections (only max-runs-per-window under user-rate-limit). DDUw should explicitly check whether scripts/generate-schema-docs.js has been re-run after a schema change rather than assume.

    Suggested wording to add under Step 4. Identify Documentation Gaps:

    When a PR modifies pkg/parser/schemas/main_workflow_schema.json, verify that the corresponding sections in docs/src/content/docs/reference/frontmatter-full.md have been updated. If the auto-generated file is out of sync, flag this as a follow-up (the generator is scripts/generate-schema-docs.js).

Related Issues

What Was Verified But Not Fixed

Generated by Daily Documentation Healer · ● 21.5M ·

  • expires on May 15, 2026, 12:10 AM UTC

…default

Adds a glossary entry for the top-level `max-effective-tokens` frontmatter
field introduced for AWF apiProxy enforcement, mirroring the existing
`max-runs` pattern. Updates the `max-runs` entry to mention the default
value of 100, set by PR #31484.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@github-actions github-actions Bot added automation documentation Improvements or additions to documentation labels May 12, 2026
@pelikhan pelikhan marked this pull request as ready for review May 12, 2026 01:17
Copilot AI review requested due to automatic review settings May 12, 2026 01:17
@pelikhan pelikhan merged commit 56acf55 into main May 12, 2026
4 checks passed
@pelikhan pelikhan deleted the doc-healer/max-effective-tokens-glossary-2026-05-12-256ce89bdfc9dea2 branch May 12, 2026 01:17
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the documentation glossary to cover recently added/updated workflow frontmatter limit fields so the reference docs match current schema/runtime defaults.

Changes:

  • Added a new glossary entry for top-level max-effective-tokens, including default value and accepted formats.
  • Updated the existing max-runs glossary entry to document the new default (100) and that GitHub Actions expressions are accepted.
Show a summary per file
File Description
docs/src/content/docs/reference/glossary.md Adds/updates glossary entries for max-effective-tokens and max-runs to reflect current defaults and supported value formats.

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 1/1 changed files
  • Comments generated: 1


### Max Effective Tokens (`max-effective-tokens`)

A top-level frontmatter field that caps the total effective-token (ET) budget the AWF proxy will spend within a single workflow run. Effective tokens are weighted by model multipliers and are the primary cost proxy for Copilot. Applies to all engines and maps to `apiProxy.maxEffectiveTokens` in the compiled lock file. Defaults to `25000000` when omitted. Accepts an integer or a GitHub Actions expression that resolves to an integer at runtime. Example:
@github-actions github-actions Bot mentioned this pull request May 12, 2026
Copy link
Copy Markdown
Contributor Author

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Skills-Based Review 🧠

Applied /grill-with-docs — the appropriate skill for documentation-only changes.

Key Themes

  • Both new/updated glossary entries accurately match the JSON schema definitions in pkg/parser/schemas/main_workflow_schema.json
  • Terminology is consistent with existing glossary vocabulary (effective tokens, AWF proxy, apiProxy.*, GitHub Actions expression)
  • The max-effective-tokens entry mirrors the structure of the adjacent max-runs entry — parallel phrasing, same format, appropriate cross-links

Positive Highlights

  • ✅ Default values (25000000 / 100) match the schema and PR #31484
  • ✅ The aw wrap code block fencing matches the pattern used throughout the glossary
  • ✅ Cross-references to the Effective Tokens Specification and Cost Management pages are correct
  • ✅ The DDUw Improvement Suggestions in the PR body are well-reasoned and actionable

Verdict

Changes are accurate, well-scoped, and consistent with the project's domain vocabulary. No issues found.

🧠 Reviewed using Matt Pocock's skills by Matt Pocock Skills Reviewer · ● 4.9M

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automation documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants