Skip to content

BV-SALA 1.2.0 — cache-aware prompt management + cross-provider shadow + live evidence

Choose a tag to compare

@ChypherC0d3 ChypherC0d3 released this 15 Nov 18:08
· 171 commits to main since this release
af02727

BV-SALA 1.2.0 — cache-aware prompt management, cross-provider shadow, live evidence

Three things in this release:

  • Cacheable-prefix reorder (savings.cachePrefix: true, opt-in). A per-request timestamp, UUID or epoch in your system prompt used to poison the provider's prefix cache: 0 % hit-rate and a full paid cache write on every call. With one flag, the layer moves those lines out of the cacheable prefix and declares only the stable part. Measured live (claude-haiku-4-5): 0 % → 95 % hit-rate, −82.8 % per request, on the provider's own counters.

  • Cross-provider shadow (savings.crossProviderShadow: true, measure-only). What your request's measured usage would have cost on DeepSeek/Qwen/GLM at list prices — basis: "shadow", nothing routed, nothing billed.

  • The preregistered roadmap, executed live: the ρ curve (14.7 % / 23.7 %), the dedup × cache_control factorial (85.9 % with attribution) and the cascade non-inferiority (67.9 %, no quality loss on a golden list). Evidence in benchmarks/evidencia/*-2026-11-15.json; paper §6.6–6.9.

npm i @bivelio/savings-layer · pip install bivelio-savings-layer