Skip to content

v0.2.0-alpha.6 — Economics

Pre-release
Pre-release

Choose a tag to compare

View all tags
@vikasagarwal101 vikasagarwal101 released this 05 Jul 04:18
v0.2.0-alpha.6
f37a992

v0.2.0-alpha.6 — "Economics"

⚠️ Pre-release software. Ships inert — the Model Governor records recommendations but the live fix path is byte-identical to alpha.5. No live model downgrades until beta.1.

Make the deterministic flywheel's cost advantage measurable and routable.

What's new

Model Governor (ADR-0022)

A tier-selection function (bluei/engine/model_governor.py) that recommends which Routing Ladder tier (tier-0 / tier-1 / tier-2 / escalate) should handle a Finding the deterministic cascade could not resolve. The sole primary signal is rule-family deterministic coverage (seeded Pattern/Recipe/Bundle count). High coverage → cheap model; low/none → frontier (the coverage gap).

  • Ships inert. The live call site uses an identity default (returns tier-2 = today's behavior). The selection function is injected via RunContext.selection_fn so beta.1's swap is a config flip, not a code edit.
  • No hardcoded model ids. The Governor emits only a tier ordinal — tier→model resolution is the backend's job at invocation via model discovery. Zero vendor model-id literals in the module.
  • The apply_claude_fix call, model_name, and cost_tracker are byte-identical to alpha.5.

Benchmark Harness (internal dev tool)

bluei/tools/benchmark/ + bluei/engine/corpus_manifest.py + bluei benchmark CLI. Replays the synthetic Seed Library corpus (130 entries across 28 rule families: 38 Golden Bundles + 38 seeded Patterns + 54 Recipes) through the cascade-simulation proxy + the Model Governor, producing:

  • Per-rule-family coverage gap analysis — which families resolve deterministically, which reach the Governor, which route to tier-2 (the expensive gap). Drives the flywheel improvement loop.
  • Flywheel Score — $ avoided per Finding under new-vs-old routing via mocked rates (explicit two-rate formula).

Static analysis only — no model invocation. Reproducible across runs.

User-facing "$ avoided" statistic

The report/dashboard now surfaces the aggregate $ avoided = savings_usd + routing_savings_usd. Under alpha.6's identity default the routing contribution is $0.00 (active in beta.1).

Summary

  • 1 new ADR (0022 — Model Governor locus + inert default + discovery-based model identity)
  • 4 new CONTEXT terms (Model Governor, Routing Ladder, Benchmark Harness, Flywheel Score)
  • 6463 → 6552 tests (+89 new, 0 regressions)
  • Ships inert — all mechanisms proven synthetically; no live runs before 0.2.0 stable

Deferred to beta.1

Act-on-recommendation (live default flip), real model discovery, validation-stability measurement, validation-history + file-criticality routing signals. See ROADMAP for the full deferral table.

Full release notes: CHANGELOG.md

Assets 2
Loading