1.3.0.dev20260609002802

Installation

Via PyPI

pip install pjrt-plugin-tt==1.3.0.dev20260609002802 --extra-index-url https://pypi.eng.aws.tenstorrent.com/
pip install vllm-tt==1.3.0.dev20260609002802 --extra-index-url https://pypi.eng.aws.tenstorrent.com/

Via Docker

docker pull ghcr.io/tenstorrent/tt-xla-slim:1.3.0.dev20260609002802

What's Changed

• Fix GPT-OSS 20B example segfault by selecting tt_dense experts backend by @devisettymahidhar608 in #5109
• [perf] Run single-chip benchmarks on stable qb2-blackhole via p150-perf label by @rpavlovicTT in #5103
• Move Training MoE Tests to QB2 by @pglusacTT in #5104
• [vLLM] Add support for Rotary Embedding with Multimodal Sections by @mmanzoorTT in #5107
• Add deepseek-v3.1 and glm4.7 benchmarks by @gengelageTT in #5097

Full Changelog: 1.3.0.dev20260608003328...1.3.0.dev20260609002802

---

LLM Performance

Model	Token/sec/user	Batch	Token/sec	ttft (ms)

Non-LLM Performance

Model	Batch	Sample/sec

Model coverage

Info: Full list of supported models is available in the assets section.

Model task	Model architecture	Model variant	Model framework	Inference	Training	n150	n300	p150	Single device	Data parallel	Tensor parallel	Model source
atomic ml	ARNOLD	Deathmatch Shotgun Rnn	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
atomic ml	ARNOLD	Defend The Center Ff	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
atomic ml	ARNOLD	Health Gathering Ff	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
atomic ml	ARNOLD	Vizdoom 2017 Track1 Rnn	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
atomic ml	ARNOLD	Vizdoom 2017 Track2 Rnn	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv depth est	GLPN-KITTI	base	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv depth est	MonoDepth2	Mono 1024x320	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv depth est	MonoDepth2	Mono 640x192	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv depth est	MonoDepth2	Mono No Pt 640x192	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv depth est	MonoDepth2	Mono+stereo 1024x320	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv depth est	MonoDepth2	Mono+stereo 640x192	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv depth est	MonoDepth2	Mono+stereo No Pt 640x192	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv depth est	MonoDepth2	Stereo 1024x320	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv depth est	MonoDepth2	Stereo 640x192	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv depth est	MonoDepth2	Stereo No Pt 640x192	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	AlexNet	B	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	AlexNet	Default	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	AlexNet	High Res	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	BEiT	Base	pytorch	✅	❌	❌	✅	❌	❌	✅	❌	View Source
cv image cls	BEiT	Large	pytorch	✅	❌	❌	✅	❌	❌	✅	❌	View Source
cv image cls	DINOv2	Base	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	DINOv2	Giant	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	DINOv2	Large	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	DLA	102	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DLA	102x	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DLA	102x2	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DLA	169	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DLA	34	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DLA	46 C	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DLA	46x C	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DLA	60	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DLA	60x	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DLA	60x C	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DeiT	Base	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DeiT	Base Distilled	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DeiT	Small	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DeiT	Tiny	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DenseNet	121	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DenseNet	121 Xray	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	DenseNet	161	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DenseNet	169	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	DenseNet	201	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	B1	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	B2	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	B3	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	B4	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	B5	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	B6	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	B7	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	Timm B0	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	Timm B0 Ra In1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	Timm B4	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	EfficientNet	Timm B4 Ra2 In1k	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	EfficientNet	Timm B5 In12k Ft In1k	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	EfficientNet	Timm Tf B0 Aa In1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	Timm Tf V2 S In21k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet	Timm V2 Rw S Ra2 In1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet-Lite	Tf Efficientnet Lite0.in1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet-Lite	Tf Efficientnet Lite1.in1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet-Lite	Tf Efficientnet Lite2.in1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet-Lite	Tf Efficientnet Lite3.in1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	EfficientNet-Lite	Tf Efficientnet Lite4.in1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	FPN	ResNet50 Backbone with FPN V2	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	GhostNet	100	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	GhostNet	100.in1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	GhostNet	v2 100.in1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	GoogLeNet	Default	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	HarDNet	hardnet68	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	Inception	V4.tf In1k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	Inception	v4	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	Inception	v4 OSMR	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	MLP-Mixer	Base	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	MLP-Mixer	Mixer B16 224	pytorch	✅	❌	❌	✅	❌	❌	✅	❌	View Source
cv image cls	MLP-Mixer	Mixer B16 224 In21k	pytorch	✅	❌	❌	✅	❌	❌	✅	❌	View Source
cv image cls	MLP-Mixer	Mixer B16 224 Miil	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	MLP-Mixer	Mixer B16 224 Miil In21k	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	MLP-Mixer	Mixer B32 224	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	MLP-Mixer	Mixer Github	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source
cv image cls	MLP-Mixer	Mixer L16 224 In21k	pytorch	✅	❌	✅	❌	❌	✅	❌	❌	View Source
cv image cls	MLP-Mixer	Mixer L32 224	pytorch	✅	❌	✅	✅	✅	✅	✅	❌	View Source