Summary of Changes
- Uplifted Llama-3.1-8B-Instruct on p150
- Added support for Qwen3.6-27B on Blackhole QuietBox 2
- Added support for gemma-4-31b-it on Blackhole QuietBox 2
- Added support for Falcon3-7B-Instruct on p150
- Added support for yolox_nano on p150
- Uplifted FLUX.1-schnell on Blackhole QuietBox 2
Model Spec Release Updates
This document shows model specification updates.
| Impl | Model Arch | Weights | Devices | TT-Metal Commit Change | Status Change | CI Job Link |
|---|---|---|---|---|---|---|
tt_transformers |
Llama-3.1-8B-Instruct |
meta-llama/Llama-3.1-8B-Instruct |
P150 | 55fd115 → c49bb76 |
No change [EXPERIMENTAL] | CI Link |
qwen36_blackhole |
Qwen3.6-27B |
Qwen/Qwen3.6-27B |
P300X2 | c49bb76 |
[EXPERIMENTAL] | CI Link |
tt_transformers |
gemma-4-31B-it |
google/gemma-4-31B-it |
P300X2 | c49bb76 |
[EXPERIMENTAL] | CI Link |
forge_vllm_plugin |
Falcon3-7B-Instruct |
tiiuae/Falcon3-7B-Instruct |
P150 | c49bb76 |
[EXPERIMENTAL] | CI Link |
tt_transformers |
yolox_nano |
yolox_nano |
P150 | c49bb76 |
[COMPLETE] | CI Link |
tt_transformers |
FLUX.1-schnell |
black-forest-labs/FLUX.1-schnell |
P300X2 | 55fd115 → c49bb76 |
No change [COMPLETE] | CI Link |
Release Artifacts Summary
Images Promoted from Models CI
- https://ghcr.io/tenstorrent/tt-inference-server/vllm-tt-metal-src-release-ubuntu-22.04-amd64:0.18.0-c49bb76-6b4a3a7
- https://ghcr.io/tenstorrent/tt-media-inference-server:0.18.0-c49bb76
- https://ghcr.io/tenstorrent/tt-media-inference-server-forge:0.18.0-c49bb76
Total: 3