Skip to content

1.5.0.dev20260811000841

Choose a tag to compare

View all tags
@tenstorrent-github-bot tenstorrent-github-bot released this 11 Aug 01:20
· 2 commits to main since this release
1.5.0.dev20260811000841
4208372
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Installation

Via PyPI

pip install tt-forge==1.5.0.dev20260811000841 --extra-index-url https://pypi.eng.aws.tenstorrent.com/

Via Docker

docker pull ghcr.io/tenstorrent/tt-forge-slim:1.5.0.dev20260811000841

Dependency commits

tt-xla commit: 225db6c3542598f6569d122b875e9ccad8e1d33c
tt-mlir commit: da6f1ce081af95630f5d679392e50a4bafa7c6ea
tt-metal commit: 5beed318d0f0d1c6212e605947fb0be80c9e0a1d

What's Changed

  • Uplift third_party/tt_forge_models to 7e486b570e422aa5da81fc10074abd68e7d3b8cb 2026-08-08 by @vvukomanTT in #1024

Full Changelog: 1.5.0.dev20260808000817...1.5.0.dev20260811000841

LLM Performance

Model Token/sec/user Batch Token/sec ttft (ms) Hardware

Non-LLM Performance

Model Batch Sample/sec Hardware

Model coverage

Info: Full list of supported models is available in the assets section.

Model task Model architecture Model variant Model framework Inference Training n150 n300 p150 Single device Data parallel Tensor parallel Model source
cv object det OWL-ViT Base Patch32 pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Llama 3.1 70B Instruct pytorch ✅ ❌ ❌ ❌ ❌ ❌ ❌ ✅ View Source
mm tts xtts_v2 gpt latents pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv object det YOLOv9 T pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Llama 3.2 3B pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls MNIST Mlp Custom 1x2 jax ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
nlp causal lm Qwen 2.5 0.5B jax ✅ ❌ ✅ ✅ ✅ ✅ ❌ ✅ View Source
nlp causal lm Mistral Ministral 8B Instruct pytorch ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
cv image cls VoVNet Ese Vovnet19b Dw.ra In1k pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv object det YOLOP Default pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Gemma 2 27B IT pytorch ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
nlp causal lm Gemma LoRA 1.1 2B IT pytorch ❌ ✅ ✅ ❌ ❌ ✅ ❌ ❌ View Source
nlp causal lm Qwen 2.5 3B Instruct pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls EfficientNet B0 pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Qwen 2.5 3B Instruct jax ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
nlp causal lm Qwen 3 1 7B jax ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
nlp causal lm Qwen 2.5 Coder 32B Instruct pytorch ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
mm visual qa Mistral base pytorch ✅ ❌ ❌ ✅ ✅ ✅ ❌ ✅ View Source
nlp causal lm Llama 3.1 8B Instruct pytorch ✅ ❌ ❌ ✅ ✅ ✅ ❌ ✅ View Source
nlp causal lm Falcon 3 3B Base pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv object det YOLOv4 Base pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls MNIST Cnn Batchnorm jax ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp token cls BiLSTM-CRF Default pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm olmo_3 3 1025 7b pytorch ✅ ❌ ❌ ❌ ✅ ✅ ❌ ❌ View Source
mm tts xtts_v2 gpt decode pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
mm tts xtts_v2 hifigan decoder pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Mistral Large INSTRUCT 2411 pytorch ✅ ❌ ❌ ❌ ❌ ❌ ❌ ✅ View Source
cv image cls MNIST Cnn Nodropout pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls MobileNetV2 Mobilenet v2 pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
conditional generation U-Net for Conditional Generation Base pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv object det YOLOv7 Default pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm GPT-2 Xl jax ❌ ✅ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv img to img Autoencoder linear pytorch ❌ ✅ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls DINOv2 Small pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv object det PointPillars pointpillars pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Qwen 2.5 3B jax ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
cv image cls ResNet ResNet50 HuggingFace High Resolution pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Llama LoRA 3.2 1B pytorch ❌ ✅ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Qwen 2.5 Coder 0.5B jax ✅ ❌ ✅ ✅ ✅ ✅ ❌ ✅ View Source
nlp causal lm ALLaM 7B Instruct pytorch ✅ ❌ ❌ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Falcon 3 7B Base pytorch ✅ ❌ ❌ ✅ ✅ ✅ ❌ ✅ View Source
nlp causal lm Gemma 1.1 7B IT pytorch ✅ ❌ ❌ ✅ ✅ ✅ ❌ ✅ View Source
nlp causal lm Phi-4 Phi 4 pytorch ✅ ❌ ❌ ✅ ✅ ✅ ❌ ✅ View Source
nlp causal lm Llama 3.1 70B pytorch ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
nlp causal lm Qwen 2 Qwq 32B pytorch ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
cv panoptic seg Panoptic Segmentation ResNet50 Backbone 1x COCO pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Phi-2 Phi 2 jax ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
mm visual qa Llama 3.2 11B Vision Instruct pytorch ✅ ❌ ❌ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm olmo_3 3 7b think pytorch ✅ ❌ ❌ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Qwen 2.5 Coder 1.5B Instruct jax ✅ ❌ ✅ ✅ ✅ ✅ ❌ ✅ View Source
cv object det ssd512 ssd512 pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Mistral Devstral Small 2505 pytorch ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
cv object det TransFuser None pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
mm image text similarity CLIP Base Patch16 pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
mm tts xtts_v2 speaker encoder pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv object det Attention DenseUNet Base pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv object det EfficientDet D0 pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm olmo_3 3 32b think pytorch ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
nlp causal lm Qwen 2.5 14B Instruct pytorch ✅ ❌ ❌ ✅ ✅ ✅ ❌ ✅ View Source
cv image cls MNIST Cnn Dropout jax ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Qwen 2.5 1.5B Instruct jax ✅ ❌ ✅ ✅ ✅ ✅ ❌ ✅ View Source
nlp causal lm Qwen 3 32B pytorch ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
nlp causal lm Qwen 3 4B jax ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
nlp causal lm Qwen 2.5 32B Instruct pytorch ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source
nlp causal lm Qwen 2.5 72B Instruct pytorch ✅ ❌ ❌ ❌ ❌ ❌ ❌ ✅ View Source
nlp causal lm SOLAR-10_7B 10 7B Instruct v1.0 pytorch ✅ ❌ ❌ ✅ ✅ ✅ ❌ ✅ View Source
nlp embed gen FLUX T5TextEncoder pytorch ✅ ❌ ❌ ❌ ❌ ✅ ❌ ❌ Source not available
nlp causal lm arcee_ai arcee Spark pytorch ✅ ❌ ❌ ❌ ✅ ✅ ❌ ❌ View Source
mm visual qa Llama 3.2 11B Vision pytorch ✅ ❌ ❌ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Phi-1 LoRA Phi 1 pytorch ❌ ✅ ✅ ❌ ✅ ✅ ❌ ❌ View Source
mm tts xtts_v2 conditioning pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Qwen 2.5 Coder 1.5B jax ✅ ❌ ✅ ✅ ✅ ✅ ❌ ✅ View Source
mm action prediction OpenVLA-OFT Finetuned Libero 10 pytorch ✅ ❌ ❌ ❌ ✅ ✅ ❌ ❌ View Source
nlp embed gen FLUX ClipTextEncoder pytorch ✅ ❌ ❌ ❌ ❌ ✅ ❌ ❌ Source not available
mm image ttt FLUX Transformer pytorch ✅ ❌ ❌ ❌ ❌ ✅ ❌ ❌ Source not available
nlp causal lm Phi-1 Phi 1 pytorch ❌ ✅ ❌ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Phi-1 Phi 1 pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls ViT Base pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
nlp causal lm Phi-1 Phi 1 jax ✅ ❌ ✅ ✅ ✅ ✅ ❌ ✅ View Source
nlp causal lm Mistral Small 24B INSTRUCT 2501 pytorch ✅ ❌ ❌ ✅ ❌ ❌ ❌ ✅ View Source

Contributors

vvukomanTT
Assets 5
Loading