Skip to content

v0.1.4

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 29 Jul 19:49
41c7f57

0.1.4 (2026-07-29)

Features

  • cli: warn when --cb is enabled on a CPU device (c8b6c63)
  • ov-genai: continuous batching via ContinuousBatchingPipeline (#20) (2229af0)

Bug Fixes

  • cli: reject --cb on an NPU device (280e1b5)
  • ov-genai: bound the cb liveness heartbeat so a wedged batch still fails (2a83442)
  • ov-genai: cb step() signals liveness so long prefills survive the stall guard (c7f14f1)
  • ov-genai: cb warmup reports failure instead of always logging ok (6420243)
  • ov-genai: report a cb scheduler eviction as an error, not a clean stop (48a342b)
  • ov-genai: stop admitting work onto a dead cb pipeline (3b2812c)
  • runner: deliver a stream's chunks in the order the engine produced them (abccce5)
  • shim: apply the chat template on the cb path (88a3a76)
  • shim: move the cb UTF-8 hold-back to Rust and make it resync (e24e2c8)

Refactor

  • shim: drop the unused cb has_unfinished entry point (13320a4)
  • shim: tie a CbHandle's lifetime to its pipeline via Arc (da219dd)

Documentation

  • ov-genai: characterise when --cb helps and when it hurts (b55c754)
  • ov-genai: correct the --cb example and three overstated claims (951a13b)
  • shim: correct the cancel-vs-stop and request_id claims (8e1c824)

Testing

  • ov-genai: cover the cb engine state machine behind a pipeline seam (f28dad0)
  • ov-genai: pin cb/LLMPipeline chat-template parity (cb34bb9)
  • shim: cover the cb resync path with unit tests (b06158d)