Add Qwen3.6 to documentation#4247
Merged
Merged
Conversation
dtrawins
approved these changes
May 27, 2026
dtrawins
reviewed
May 27, 2026
| ::: | ||
| :::{tab-item} Qwen3.6-35B-A3B | ||
| :sync: Qwen3.6-35B-A3B | ||
| Vision Language MoE model (35B total / 3B active parameters). Requires OpenVINO 2026.2 or newer and enough host memory to fit the INT4 weights. |
Collaborator
There was a problem hiding this comment.
can you make is more specific? also weights is not enough because KV cache needs to be allocated and image embeddings can consume extra RAM. Minumum 21GB VRAM plus KV cache for text generation and image processing embeddings depending on the resolution and image count.
We could add like tested on PantherLake iGPU with 32GB RAM and iGPU allocation increased and B70 dGPU.
mzegla
approved these changes
May 28, 2026
Collaborator
mzegla
left a comment
mzegla
left a comment
There was a problem hiding this comment.
Approving, but take a look at the comments. Not sure if it;s fine to keep weekly tags and 2026.1 links
| > **Note**: Image source: [Link](https://images.pexels.com/photos/20015887/pexels-photo-20015887.jpeg) | ||
|
|
||
| ```bat | ||
| python openai_agent.py --query "What is the current weather in location depicted in the image?" --image https://raw.githubusercontent.com/openvinotoolkit/model_server/refs/heads/releases/2026/1/demos/continuous_batching/agentic_ai/photo.jpeg --model OpenVINO/Qwen3.6-35B-A3B-int4-ov --base-url http://localhost:8000/v3 --mcp-server-url http://localhost:8080/sse --mcp-server weather |
Collaborator
Author
There was a problem hiding this comment.
to be addressed in another pr
| Pull and start OVMS: | ||
| ```bash | ||
| mkdir -p ${HOME}/models | ||
| docker run -d --user $(id -u):$(id -g) --rm -p 8000:8000 -v ${HOME}/models:/models openvino/model_server:weekly \ |
Collaborator
Author
There was a problem hiding this comment.
to be addressed in another pr
| > **Note**: Image source: [Link](https://images.pexels.com/photos/20015887/pexels-photo-20015887.jpeg) | ||
|
|
||
| ```bash | ||
| python openai_agent.py --query "What is the current weather in location depicted in the image?" --image https://raw.githubusercontent.com/openvinotoolkit/model_server/refs/heads/releases/2026/1/demos/continuous_batching/agentic_ai/photo.jpeg --model OpenVINO/Qwen3.6-35B-A3B-int4-ov --base-url http://localhost:8000/v3 --mcp-server-url http://localhost:8080/sse --mcp-server weather |
Collaborator
Author
There was a problem hiding this comment.
to be addressed in another pr
| Pull and start OVMS: | ||
| ```bash | ||
| mkdir -p ${HOME}/models | ||
| docker run -d --user $(id -u):$(id -g) --rm -p 8000:8000 -v ${HOME}/models:/models --device /dev/dri --group-add=$(stat -c "%g" /dev/dri/render* | head -n 1) openvino/model_server:weekly \ |
Collaborator
Author
There was a problem hiding this comment.
to be addressed in another pr
| > **Note**: Image source: [Link](https://images.pexels.com/photos/20015887/pexels-photo-20015887.jpeg) | ||
|
|
||
| ```bash | ||
| python openai_agent.py --query "What is the current weather in location depicted in the image?" --image https://raw.githubusercontent.com/openvinotoolkit/model_server/refs/heads/releases/2026/1/demos/continuous_batching/agentic_ai/photo.jpeg --model OpenVINO/Qwen3.6-35B-A3B-int4-ov --base-url http://localhost:8000/v3 --mcp-server-url http://localhost:8080/sse --mcp-server weather |
Collaborator
Author
There was a problem hiding this comment.
to be addressed in another pr
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🛠 Summary
JIRA/Issue if applicable.
Describe the changes.
🧪 Checklist
``