v0.1.6

0.1.6 (2026-08-04)

Features

• npu: continuous batching on the NPU via packed multi-slot decode (7cd3190)
• npu: multi-stage packed wire + per-slot cancel (63e44ee)
• npu: packed multi-slot substrate for continuous batching (seq-as-batch) (f36c408)
• npu: prefix caching via a shared read-only KV region (14c9903)
• npu: wire packed multi-slot execution into OvRuntimeEngine (9ab6746)

Bug Fixes

• dist-spec: remove a byte-offset slice that could panic the worker (6ba63b6)
• npu: answer 413, not 503, when a prompt cannot fit a packed slot (165fcdd)
• npu: bound the packed multi-stage reply wait (6560dda)
• npu: complete packed prefill inside one step + report prompt_tokens (481174b)
• npu: keep attention sinks when a packed slot's KV region slides (62efd11)
• npu: packed usage double-count + f16 wire dtype; document parity findings (866544a)
• npu: packed wire must use the block_in_place-aware dispatch (126b232)
• npu: refuse a packed prompt that cannot fit its slot's KV region (fee9c33)
• npu: refuse a packed variant narrower than its own slot count (c5e64c7)
• npu: withhold multi-stage packed — it can lose a token frame and wedge (db18d0d)
• runtime: keep attention sinks when the single-task KV ring slides (feff6b1)
• runtime: stop the ov-runtime delta duplicating on a resolved glyph (428a875)

Performance

• npu: skip the prefill-variant compile in packed mode + NPU e2e results (205f894)

Documentation

• npu: fix stale plan-frame shape in perf doc — [1,3,S], not [1,2,S] (0435285)
• npu: point the multi-stage gate at its tracking issue (637cb96)
• npu: reconcile packed-slots with #116 continuous batching (1ef825f)
• npu: record the packed-slots end-to-end run (1bd4009)

Testing

• npu: add solo-only capture mode (8f0efe4)
• npu: end-to-end accuracy parity harness for packed multi-slot decode (3a034a9)
• npu: scored long-form accuracy benchmark (6eff7c3)
• npu: scored task-accuracy benchmark for packed decode (10a76f0)