Skip to content

OpenVINO Model Server 2026.4.0

Choose a tag to compare

View all tags
@atobiszei atobiszei released this 17 Sep 13:48
· 11 commits to releases/2026/4 since this release
v2026.4.0
497a846
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

New models highlights:

Added support for Qwen3.8-27B model

Improved accuracy for Gemma-4-26B-a4B on GPU accelerators

Added support for Muse-Glimmer-30B model including native function calling

Added support for Kokoro model in speech generation pipeline with execution on NPU accelerator

New capabilities:

Introduced preview support for idle model management, enabling models to be automatically unloaded to free RAM when not in use.

Added option to relax input count validation in KServe API --disable_input_count_validation

Performance:

Added preview support for MTP and DFlash

Added support for Eagle-3 speculative decoding, including tree drafting and chain drafting

Fixes:

Resolved issues in NPU execution for Qwen3-Embedding and Qwen3 when context length exceeds 8k tokens. Added configuration parameter --max_length for context length configuration to reduce memory usage in NPU

Fixed problem in structured output and handling "#" character

Security related improvements

Internal changes and improvements:

Updated Azure SDK and removed boost dependency from the Linux build

You can use OpenVINO Model Server public Docker images based on Ubuntu via the following command:

  • docker pull openvino/model_server:2026.4.0 - CPU device support with image based on Ubuntu 24.04
  • docker pull openvino/model_server:2026.4.0-gpu - GPU, NPU and CPU device support with image based on Ubuntu 24.04

or use provided binary packages. Only packages with suffix _python_on have support for python.

There is also additional distribution channel via https://storage.openvinotoolkit.org/repositories/openvino_model_server/packages/2026.4.0/

Assets 18
Loading