Skip to content

rulvar v1.1.0

Latest

Choose a tag to compare

@o-stepper o-stepper released this 11 Jul 20:02
df299f7

The 13 lockstep packages move to 1.1.0 (@rulvar/compat stays 0.1.0). Published through npm trusted publishing (OIDC) from release.yml, with provenance.

New in @rulvar/evals (minor): the M12 measured-value checkpoint harness. runValueCheckpoint executes the OQ-09 gate as two A/B experiments under one fixed pool (rung selection per ladder and taskClass cell; agentType selection with and without the knowledge store), with renderCheckpointReport producing the docs-ready record. The fixed mixed corpus and the budget-guarded live Anthropic runner ship as repo scripts. The gate itself ran live and FAILED (criterion 1 held, criterion 2 failed the cost bar), so ModelKnowledge phase 3 stays unshipped; the record lives in docs/checkpoints/2026-07-11-m12-value-checkpoint.md and docs/14 OQ-09.

Fixes found by the live checkpoint runs:

  • @rulvar/anthropic: a Haiku 4.5 capability entry (enabled-budget thinking form, real pricing); the router scrubs the effort parameter off the wire for models that reject it; the adapter scrubs constrained-decoding-unsupported schema keywords (minimum, maximum, exclusiveMinimum, exclusiveMaximum, multipleOf, maxItems) from the wire copy of strict tool schemas and output format schemas, with the engine still validating against the full schema (docs/04 4.3 as amended).
  • @rulvar/core: plain orchestrate treats ladder-declaring profiles as declaration-only: the spawn vocabulary advertises concrete profiles with declarers on a context line, and spawning a declarer is rejected with a typed ConfigError before admission (docs/07 section 10 as amended).
  • @rulvar/evals: criterion 2 cannot pass vacuously (an all-zero arm fails); orchestrated arms take their own suite budget (orchestratedSuite) so the orchestrator cap math stays solvent under a small per-case ceiling.

Full per-package changelogs: https://github.com/o-stepper/rulvar/blob/main/packages/core/CHANGELOG.md and siblings.