1.5.0.dev20260819000359

Installation

Via PyPI

pip install tt-forge==1.5.0.dev20260819000359 --extra-index-url https://pypi.eng.aws.tenstorrent.com/

Via Docker

docker pull ghcr.io/tenstorrent/tt-forge-slim:1.5.0.dev20260819000359

Dependency commits

tt-xla commit: 2ddaf4bc36f7def52dc60d392c820ab464e99f30
tt-mlir commit: 71046369d603b97fd6a8dd8b947ca8588ac2a74f
tt-metal commit: 5beed318d0f0d1c6212e605947fb0be80c9e0a1d

What's Changed

• Uplift third_party/tt_forge_models to 464c104944cb42b25ac83e02f03a5a238572eda2 2026-08-15 by @vvukomanTT in #1025

Full Changelog: 1.5.0.dev20260815000421...1.5.0.dev20260819000359

---

LLM Performance

Model	Token/sec/user	Batch	Token/sec	ttft (ms)	Hardware

Non-LLM Performance

Model	Batch	Sample/sec	Hardware

Model coverage

Info: Full list of supported models is available in the assets section.

Model task	Model architecture	Model variant	Model framework	Inference	Training	n150	n300	p150	Single device	Data parallel	Tensor parallel	Model source
cv image cls	EfficientNet	B0	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Gemma	2 2B IT	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv object det	YOLOv4	Base	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
mm tts	xtts_v2	gpt prefill	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv object det	YOLOP	Default	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Llama LoRA	3.2 1B	pytorch	❌	✅	✅	❌	✅	✅	❌	❌	View Source
mm image ttt	FLUX	Transformer	pytorch	✅	❌	❌	❌	❌	✅	❌	❌	Source not available
cv object det	ssd512	ssd512	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp embed gen	FLUX	ClipTextEncoder	pytorch	✅	❌	❌	❌	❌	✅	❌	❌	Source not available
nlp causal lm	Qwen 2.5	3B	jax	✅	❌	❌	✅	❌	❌	❌	✅	View Source
nlp causal lm	GPT-OSS	20B	pytorch	✅	❌	❌	✅	❌	❌	❌	✅	View Source
nlp causal lm	olmo_3	3 7b think	pytorch	✅	❌	❌	❌	✅	✅	❌	❌	View Source
cv panoptic seg	Panoptic Segmentation	ResNet50 Backbone 1x COCO	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Falcon	3 10B Base	pytorch	✅	❌	❌	✅	✅	✅	❌	✅	View Source
nlp causal lm	Mistral	7B INSTRUCT v03	pytorch	✅	❌	❌	✅	✅	✅	❌	✅	View Source
cv object det	TransFuser	None	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	VGG	HF Vgg19	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	GPT-2	Xl	jax	❌	✅	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Qwen 2.5	0.5B Instruct	jax	✅	❌	✅	✅	✅	✅	❌	✅	View Source
nlp causal lm	Falcon	3 7B Base	pytorch	✅	❌	❌	✅	✅	✅	❌	✅	View Source
mm visual qa	Mistral	base	pytorch	✅	❌	❌	✅	✅	✅	❌	✅	View Source
nlp causal lm	Qwen 2.5	1.5B Instruct	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv object det	EfficientDet	D0	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	olmo_3	3 1025 7b	pytorch	✅	❌	❌	❌	✅	✅	❌	❌	View Source
mm tts	xtts_v2	gpt latents	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Falcon	3 1B Base	pytorch	✅	❌	✅	✅	✅	✅	❌	✅	View Source
nlp causal lm	Qwen 2.5	1.5B Instruct	jax	✅	❌	✅	✅	✅	✅	❌	✅	View Source
cv img to img	Autoencoder	linear	pytorch	❌	✅	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Mistral	Ministral 8B Instruct	pytorch	✅	❌	❌	✅	❌	❌	❌	✅	View Source
cv image cls	MNIST	Cnn Nodropout	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image seg	VGG19-UNet	base	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Phi-2	Phi 2	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Qwen 2.5	0.5B Instruct	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Phi-1.5	Phi 1 5	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Qwen 2.5 Coder	1.5B Instruct	jax	✅	❌	✅	✅	✅	✅	❌	✅	View Source
nlp causal lm	ALLaM	7B Instruct	pytorch	✅	❌	❌	❌	✅	✅	❌	❌	View Source
nlp causal lm	Gemma	1.1 2B IT	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv object det	YOLOv9	T	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Falcon	3 3B Base	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Qwen 3	4B	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Phi-4	Phi 4	pytorch	✅	❌	❌	✅	✅	✅	❌	✅	View Source
cv image seg	Ultra-Fast Lane Detection	TuSimple ResNet18 Backbone	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	ResNet	ResNet50 HuggingFace High Resolution	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	olmo_3	3 7b instruct	pytorch	✅	❌	❌	❌	✅	✅	❌	❌	View Source
nlp causal lm	Qwen 3	4B	jax	✅	❌	❌	✅	❌	❌	❌	✅	View Source
nlp causal lm	Gemma	1.1 7B IT	pytorch	✅	❌	❌	✅	✅	✅	❌	✅	View Source
nlp causal lm	Llama	3.2 1B	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	MNIST	Cnn Batchnorm	jax	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Qwen 2.5	0.5B	jax	✅	❌	✅	✅	✅	✅	❌	✅	View Source
cv object det	DETR	ResNet50 Backbone	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Mistral	Nemo INSTRUCT 2407	pytorch	✅	❌	❌	❌	✅	✅	❌	❌	View Source
cv image cls	VoVNet	Ese Vovnet19b Dw.ra In1k	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv object det	YOLOS Small	Small	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp token cls	BiLSTM-CRF	Default	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
mm visual qa	Llama	3.2 11B Vision	pytorch	✅	❌	❌	❌	✅	✅	❌	❌	View Source
cv image cls	MobileNetV2	Mobilenet v2	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Qwen 3	0 6B	pytorch	✅	❌	✅	✅	✅	✅	❌	✅	View Source
nlp causal lm	Gemma	2 27B IT	pytorch	✅	❌	❌	✅	❌	❌	❌	✅	View Source
mm action prediction	OpenVLA-OFT	Finetuned Libero 10	pytorch	✅	❌	❌	❌	✅	✅	❌	❌	View Source
cv object det	OWL-ViT	Base Patch32	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	SegFormer	Mit B0	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	GPT-2	Base	jax	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Llama	3.1 70B	pytorch	✅	❌	❌	✅	❌	❌	❌	✅	View Source
mm visual qa	Llama	3.2 11B Vision Instruct	pytorch	✅	❌	❌	❌	✅	✅	❌	❌	View Source
mm image ttt	FLUX	Vae	pytorch	✅	❌	❌	❌	❌	✅	❌	❌	Source not available
nlp causal lm	Phi-3	Mini Instruct	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Qwen 2.5 Coder	3B Instruct	jax	✅	❌	❌	✅	❌	❌	❌	✅	View Source
conditional generation	U-Net for Conditional Generation	Base	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp embed gen	FLUX	T5TextEncoder	pytorch	✅	❌	❌	❌	❌	✅	❌	❌	Source not available
nlp causal lm	arcee_ai	arcee Spark	pytorch	✅	❌	❌	❌	✅	✅	❌	❌	View Source
nlp causal lm	Llama	3.2 3B	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Qwen 2.5	3B Instruct	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
cv image cls	MNIST	Mlp Custom 1x2	jax	✅	❌	❌	✅	❌	❌	❌	✅	View Source
nlp causal lm	Qwen 2.5 Coder	1.5B	jax	✅	❌	✅	✅	✅	✅	❌	✅	View Source
cv image cls	MNIST	Cnn Dropout	jax	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Mistral	Small 24B INSTRUCT 2501	pytorch	✅	❌	❌	✅	❌	❌	❌	✅	View Source
nlp causal lm	Qwen 2.5	32B Instruct	pytorch	✅	❌	❌	✅	❌	❌	❌	✅	View Source
cv image cls	Swin	S	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
mm tts	xtts_v2	gpt decode	pytorch	✅	❌	✅	❌	✅	✅	❌	❌	View Source
nlp causal lm	Qwen 2.5 Coder	3B	jax	✅	❌	❌	✅	❌	❌	❌	✅	View Source