v0.1.4
Pre-release
Pre-release
0.1.4 (2026-07-29)
Features
- cli: warn when --cb is enabled on a CPU device (c8b6c63)
- ov-genai: continuous batching via ContinuousBatchingPipeline (#20) (2229af0)
Bug Fixes
- cli: reject --cb on an NPU device (280e1b5)
- ov-genai: bound the cb liveness heartbeat so a wedged batch still fails (2a83442)
- ov-genai: cb step() signals liveness so long prefills survive the stall guard (c7f14f1)
- ov-genai: cb warmup reports failure instead of always logging ok (6420243)
- ov-genai: report a cb scheduler eviction as an error, not a clean stop (48a342b)
- ov-genai: stop admitting work onto a dead cb pipeline (3b2812c)
- runner: deliver a stream's chunks in the order the engine produced them (abccce5)
- shim: apply the chat template on the cb path (88a3a76)
- shim: move the cb UTF-8 hold-back to Rust and make it resync (e24e2c8)
Refactor
- shim: drop the unused cb has_unfinished entry point (13320a4)
- shim: tie a CbHandle's lifetime to its pipeline via Arc (da219dd)
Documentation
- ov-genai: characterise when --cb helps and when it hurts (b55c754)
- ov-genai: correct the --cb example and three overstated claims (951a13b)
- shim: correct the cancel-vs-stop and request_id claims (8e1c824)