Skip to content

OpenVINO Model Server 2026.4.1

Latest

Choose a tag to compare

@przepeck przepeck released this 06 Oct 21:12
· 2 commits to releases/2026/4 since this release
6c25e51

This is a hotfix release including bug fixes in the server component and OpenVINO Runtime.

Improvements included:

  • Updated OpenVINO Runtime to 2026.4.1 version.
  • DFlash algorithm can not accept requests without setting max_tokens parameter. Earlier, deployment with DFlash algorithm, it was mandatory to set max_tokens in all request to LLM models. Check Speculative Decoding Demo for instructions how to run it.
  • Fixed duplicated reporting of model /v1/models endpoint when Idle model management is enabled. #4604

Deprecation notice

Starting from next release the following capabilities are planned to be dropped:

  • packages targeted on Ubuntu22 will not be published. Best effort support for building will be supported until 2027.0. There is planned adding Ubuntu26 packages.
  • MediaPipe calculators using TensorFlow dependency will be removed from OVMS. In result demos iris_tracking and holistic will be removed. Other calculators with improved performance will be added instead.

You can use OpenVINO Model Server public Docker images based on Ubuntu via the following command:

  • docker pull openvino/model_server:2026.4.1 - CPU device support with image based on Ubuntu 24.04
  • docker pull openvino/model_server:2026.4.1-gpu - GPU, NPU and CPU device support with image based on Ubuntu 24.04

or use provided binary packages. Only packages with suffix _python_on have support for python.

There is also additional distribution channel via https://storage.openvinotoolkit.org/repositories/openvino_model_server/packages/2026.4.1/