Skip to content

v0.2.6

Latest

Choose a tag to compare

@github-actions github-actions released this 26 Oct 15:57
0d2acfe

0.2.6 (2026-10-26)

Features

  • cli: --elastic memory posture + --ov-config passthrough (Linux interposer, Windows Detours hook, conformance suites) (f09c84a)
  • doctor: report the OpenVINO GenAI version built against and loaded (2f9f0fb)
  • inkling: multi-stream decode (single stage + pipeline micro-batches), cache-aware batched MoE (98a0feb)

Bug Fixes

  • conformance: fail C3 closed when the stock leg also survives; bind test servers to loopback (9db0f46)
  • deploy: ranks listen on RELAY_PORT+rank; apply-update keeps the operator's fleet.env (f5eba35)
  • deps: bump quinn-proto to 0.11.19 for October advisories (932548e)
  • deps: bump rustls-webpki to 0.103.16 for RUSTSEC-2026-0382 (7bfe20d)
  • deps: bump tokio to 1.53.3 for RUSTSEC-2026-0386 (7c4741f)
  • deps: bump webpki-roots to 1.0.11 for RUSTSEC-2026-0381 (8f97722)
  • deps: clear October 2026 rustls-webpki, webpki-roots, quinn-proto and tokio advisories (75a2ca2)
  • elastic: build the interposer on Linux only (aa5a932)
  • engine: a local failure on rank 0 no longer re-dials a healthy downstream (2d65b98)
  • engine: close the link when a worker stream frame fails (6c3f10e)
  • engine: drain owed stream replies on a local failure (5ced734)
  • engine: feed a lone long prompt until it ends or a chunk comes out (804f686)
  • engine: hold back stream text on a token decode error (3f4cc34)
  • engine: log failed idle re-dials of the downstream link (56a001a)
  • engine: long prompts travel as StreamFeed windows instead of taking the chain down (ef07a27)
  • engine: reject stream frames for a free or repeated slot (3683e57)
  • engine: warn when a stream or API env var is rejected (4122ce0)
  • inkling: the batched MoE path grows the expert cache on decode rows only (91f8056)
  • inkling: warn when CASCADIA_INKLING_EXPERT_CACHE_MIB is rejected (c80cd6d)
  • setup: keep setup-openvino.ps1 ASCII so Windows PowerShell 5.1 parses it (60acb67)
  • setup: quote the printed ov_sdk.py path for spaced checkouts (c0b9134)
  • setup: read the OpenVINO GenAI pin from release.yml in setup scripts (eeafd05)
  • sparse-moe: spell the StreamFeed frame code without a suffix-like digit group (88e2eea)
  • transport: wait_readable lives on ActivationStream after the UDS merge (fd32730)

Documentation

  • choosing the OpenVINO version (INSTALL.md, setup scripts) (796cc98)
  • engine: put each doc comment on its own item (60969df)
  • engine: update stale multi-stream comments (eb0c789)
  • inkling: correct the expert cache cap and restore open follow-ups (2ddc715)
  • inkling: make the multi-stream perf note match the code and tests (030f83f)
  • inkling: note that the f32 fused MoE does not compile on the Arc 140V (6996ac1)
  • inkling: remove deploy kit and fleet tool references from the perf note (7972943)
  • qwen3.8: tell 2026.4.1.0 bundle users when to run convert_tokenizer (caed2bf)
  • refresh OpenVINO GenAI examples to the 2026.4.1.0 pin (2fab62e)

Testing

  • conformance: runtime checks for the --elastic posture (Linux cgroup suite + Windows psapi/Job Object port), with the review fixes: C3/W4 fail closed when the cap is above stock's knee, loopback-bound test servers, documented C1/C3 criteria. (2c909c4)
  • inkling: a link loss while streams are in flight (c7e19b3)
  • inkling: a rank-0 decode panic keeps the multi-stream link (6feec8d)
  • inkling: assert that four groups keep all four ranks busy at once (c9e10c5)
  • inkling: cancel a stream during decode, pipeline and single stage (21a58b1)
  • inkling: check cache hits per pass and that prefill does not grow the cache (fdd64f5)
  • inkling: check that a cancelled feed leaves no stream on rank 0 (a144a57)
  • inkling: cover the slot-count mismatch and the context cap (0bec261)
  • inkling: cover the stream-mode last rank's idle wait (0a55a69)
  • inkling: drive a lone multi-window prompt through the runner (bb4d9e8)
  • inkling: the single-stage multi-stream scheduler against the one-task path (5c2fa9d)
  • transport: cover wait_readable on TCP and Unix sockets (b0428ab)

CI

  • pin OpenVINO GenAI 2026.4.1 stable and make the bundled version selectable (ov_version, dry_run, scripts/ov_sdk.py) (9e0cedc)
  • pin validated OpenVINO GenAI 2026.4.1 stable (404c5cd)
  • release: don't let OV_EXTRA_VERSIONS variant legs block promotion (edf10e9)
  • release: fail the bundle smoke test on doctor's GenAI skew warning (b0adb38)
  • release: make the bundled OpenVINO GenAI version selectable (d06ae35)
  • release: only trust a published .sha256 that names the fetched archive (82361c5)
  • release: warn on missing variant bundles in promote (91e54ed)

Miscellaneous

  • deps: bump rustls to 0.23.46 (833e743)
  • inkling: drop the fleet deployment kit and the streams showcase from this PR (6c03aeb)