Skip to content

Augustus 0.7.1 — sharper uncertainty routing and verified patrol findings

Choose a tag to compare

@24601 24601 released this 23 Sep 17:45
· 191 commits to main since this release
3c96a61

Released 2026-09-23. This patch refines existing guidance; it adds no provider
integration, model, or new workflow capability. TypeSafe Jev remains the
default hosted exemplar, and exact rules, classical models, and human processes
remain valid alternatives. Nothing here claims a measured deployment gain.

What changed in the skill

  • Uncertainty routing and deferral. The judgment-class section now uses
    one three-option menu to show that entropy and top-option mass can rank the
    same cases differently: (0.5, 0.5, 0) has 1 bit, while (0.6, 0.2, 0.2) has
    more top mass and about 1.371 bits. The old example compared two menu sizes,
    and normalization erased its reversal. Deferral is stated as theory: defer
    when the head's error on a case exceeds the handler's expected loss there,
    query cost included, both conditioned on what the router sees. Population
    calibration of the head is not enough. Chow's rule is the constant-loss case. A
    rejector fit to representative handler outcomes is allowed. The handler
    decides deferred cases and policy authorizes the act; the earlier wording let
    a model handler "own" it. Dominance is now convention-free: "if one act never
    costs less, always take the other."
  • Five promotions from the 2026-09-23 patrol, each kept because it changes a
    design decision:
    • Preflight rejects one-option or one-level questions. Their confidence is
      1.0 by construction.
    • The diagnosis table now covers name bias, not only position bias.
    • Done-checks need evidence the judged system cannot forge. A deterministic
      check is not independent if the agent can edit what it reads.
    • Post-deployment error needs outcomes on every case or a known-probability
      audit sample weighted by inverse inclusion probability, not review queues
      or complaints alone. Reviewer accuracy is
      measured under the deployed display.
    • Labels from an automated check are not independent gold. Where every
      route can be scored on the same cases, the per-case best bounds a
      router's quality gain.
  • Task-routed entry point. The reference table is organized by what the
    user is doing and names the two offline scripts. One-off choices test
    sensitivity to weights and uncertain estimates, missing criteria, dominated
    options, and value of information instead of a held-out population.
  • Consolidation. references/formal-semi-formal.md is removed; its rules
    live in formal-methods.md, mappings.md §12, and mental-models.md.
    Repeated exemplar disclaimers and duplicated lists now appear once. Runtime
    references drop from 179,929 to 172,817 bytes. Two independent verifier
    lenses checked every cut against its owning passage.
  • Smaller fixes. evaluate_decisions.py --help documents its input rows.
    Script paths use <skill-dir>. The example selective band follows from its
    own costs. The FAQ no longer implies a Noul confidence field. TypeAR links to
    its new name, TypeLLM.

The skill description and activation examples are unchanged.

Upgrade notes

Reinstall from the v0.7.1 tag with your existing method; avoid duplicate
installations. A Claude Code marketplace pinned to @v0.7.0 stays there: run
claude plugin marketplace remove augustus, then add
24601/Augustus@v0.7.1 and install again. Anything that linked
references/formal-semi-formal.md should link references/formal-methods.md.
The bundled scripts keep their valid-input interfaces; only
evaluate_decisions.py help text changed. The skill needs no API key.

Repository changes

make check now enforces release-surface parity: CITATION, a dated changelog
heading, a pinned README install, and linked release notes must match a
non-prerelease version. It also rejects frontmatter keys outside the Agent
Skills spec, angle brackets in the description, and non-string metadata. The
release smoke installs from a git archive export. An opt-in, paid
claude plugin eval suite measures implicit activation with and without the
plugin, and an offline test keeps it honest. Eight new behavioral scenarios
cover the promoted rules and two non-trigger controls.

Evidence and limits

Two independent verifier lenses, evidence fidelity and a doctrine skeptic,
checked every proposed edit. An independent Codex gpt-6-astra review
(reasoning effort max) found two P1s and one P2. All three were fixed, and a
second pass accepted the fixes.

Fresh agents answered all 38 behavioral scenarios using only the candidate
skill. Fable 5.1 graded the answers and reported no blocking finding: 271
aspect passes and two non-blocking notes on answer wording. A blind comparison
with 0.7.0 on the seven affected scenarios found the candidate better on two,
the same on four, and 0.7.0 slightly better on one (portfolio). That result led
to a wording fix, which a rerun confirmed. These are qualitative smoke
results, not a measured outcome improvement.

A pre-registered activation A/B (20 queries, 3 runs each, isolated) kept the
current description. A proposed rewrite fixed two missed triggers but falsely
triggered on a generic BLEU/ROUGE request.

Read the patrol and 0.7.1 review evidence
and the 0.7.1 acceptance record.
Every third-party number remains Reported. No provider inference ran and no
third-party benchmark was reproduced. Requested model routing is recorded
separately from observed identity and is not backend attestation. Historical
TypeSafe skill provenance remains v0.5.7 (65a39f3), rechecked on 2026-09-23
as that repository's latest tag and HEAD.

Earlier release: v0.7.0.

Install:

claude plugin marketplace add 24601/Augustus@v0.7.1
claude plugin install augustus@augustus

npx skills add https://github.com/24601/Augustus/tree/v0.7.1/.agents/skills/augustus