·
46 commits
to main
since this release
6ab1de7
This commit was signed with the committer’s verified signature.
vcankovicTT
Veljko Cankovic
Summary of Changes
- Uplifted Qwen3.6-27B on on Blackhole QuietBox 2
- Added support for Qwen3-Embedding-4B on Blackhole QuietBox 2
- Added support for Qwen3-Embedding-0.6B on Blackhole QuietBox 2
- Added support for bge-m3 on Blackhole QuietBox 2
Model Spec Release Updates
This document shows model specification updates.
| Impl | Model Arch | Weights | Devices | TT-Metal Commit Change | Status Change | CI Job Link |
|---|---|---|---|---|---|---|
qwen36_blackhole |
Qwen3.6-27B |
Qwen/Qwen3.6-27B |
P300X2 | de59f8a |
No change [EXPERIMENTAL] | CI Link |
forge_vllm_plugin |
Qwen3-Embedding-4B |
Qwen/Qwen3-Embedding-4B |
P300X2 | de59f8a |
[EXPERIMENTAL] | CI Link |
forge_vllm_plugin |
Qwen3-Embedding-0.6B |
Qwen/Qwen3-Embedding-0.6B |
P300X2 | de59f8a |
[EXPERIMENTAL] | CI Link |
forge_vllm_plugin |
bge-m3 |
BAAI/bge-m3 |
P300X2 | de59f8a |
[EXPERIMENTAL] | CI Link |
Release Artifacts Summary
Images Promoted from Models CI
- https://ghcr.io/tenstorrent/tt-inference-server/vllm-tt-metal-src-release-ubuntu-22.04-amd64:0.20.0-de59f8a-03fa3af
- https://ghcr.io/tenstorrent/tt-media-inference-server-forge:0.20.0-de59f8a
Total: 2