Skip to content

1.4.0.dev20260716001804

Choose a tag to compare

View all tags
@tenstorrent-github-bot tenstorrent-github-bot released this 16 Jul 01:03
1.4.0.dev20260716001804
b1f4268
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Installation

Via PyPI

pip install tt-forge==1.4.0.dev20260716001804 --extra-index-url https://pypi.eng.aws.tenstorrent.com/

Via Docker

docker pull ghcr.io/tenstorrent/tt-forge-slim:1.4.0.dev20260716001804

Dependency commits

tt-xla commit: be50df5d7b12a9723469300f4850c47e2f58dc70
tt-mlir commit: 260d4c495fd5bebbfda3d48bc2e575514ec396f0
tt-metal commit: 13adda80c119631d18b0bc06163416ba148c25ab

What's Changed

  • Uplift third_party/tt_forge_models to 7f1ab80e38802437070ca6a102ace98d5ae49267 2026-07-11 by @vvukomanTT in #1019

Full Changelog: 1.4.0.dev20260711001825...1.4.0.dev20260716001804

LLM Performance

Model Token/sec/user Batch Token/sec ttft (ms) Hardware

Non-LLM Performance

Model Batch Sample/sec Hardware

Model coverage

Info: Full list of supported models is available in the assets section.

Model task Model architecture Model variant Model framework Inference Training n150 n300 p150 Single device Data parallel Tensor parallel Model source
atomic ml ARNOLD Deathmatch Shotgun Rnn pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
atomic ml ARNOLD Defend The Center Ff pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
atomic ml ARNOLD Health Gathering Ff pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
atomic ml ARNOLD Vizdoom 2017 Track1 Rnn pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
atomic ml ARNOLD Vizdoom 2017 Track2 Rnn pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv depth est GLPN-KITTI base pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv depth est MonoDepth2 Mono 1024x320 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv depth est MonoDepth2 Mono 640x192 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv depth est MonoDepth2 Mono No Pt 640x192 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv depth est MonoDepth2 Mono+stereo 1024x320 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv depth est MonoDepth2 Mono+stereo 640x192 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv depth est MonoDepth2 Mono+stereo No Pt 640x192 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv depth est MonoDepth2 Stereo 1024x320 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv depth est MonoDepth2 Stereo 640x192 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv depth est MonoDepth2 Stereo No Pt 640x192 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls AlexNet B pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls AlexNet Default pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls AlexNet High Res pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls BEiT Base pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls BEiT Large pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DINOv2 Base pytorch ✅ ❌ ✅ ❌ ❌ ✅ ❌ ❌ View Source
cv image cls DINOv2 Giant pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls DINOv2 Large pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls DLA 102 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DLA 102x pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DLA 102x2 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DLA 169 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DLA 34 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DLA 46 C pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DLA 46x C pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DLA 60 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DLA 60x pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DLA 60x C pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls DeiT Base pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls DeiT Base Distilled pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DeiT Small pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DeiT Tiny pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DenseNet 121 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DenseNet 121 Xray pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls DenseNet 161 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DenseNet 169 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls DenseNet 201 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet B1 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet B2 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet B3 pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls EfficientNet B4 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet B5 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet B6 pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls EfficientNet B7 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet Timm B0 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet Timm B0 Ra In1k pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls EfficientNet Timm B4 pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls EfficientNet Timm B4 Ra2 In1k pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls EfficientNet Timm B5 In12k Ft In1k pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls EfficientNet Timm Tf B0 Aa In1k pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet Timm Tf V2 S In21k pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet Timm V2 Rw S Ra2 In1k pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet-Lite Tf Efficientnet Lite0.in1k pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet-Lite Tf Efficientnet Lite1.in1k pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls EfficientNet-Lite Tf Efficientnet Lite2.in1k pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet-Lite Tf Efficientnet Lite3.in1k pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls EfficientNet-Lite Tf Efficientnet Lite4.in1k pytorch ✅ ❌ ✅ ✅ ❌ ✅ ✅ ❌ View Source
cv image cls FPN ResNet50 Backbone with FPN V2 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls GhostNet 100 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls GhostNet 100.in1k pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls GhostNet v2 100.in1k pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls GoogLeNet Default pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls HarDNet hardnet68 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls Inception V4.tf In1k pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls Inception v4 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls Inception v4 OSMR pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls MLP-Mixer Base pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls MLP-Mixer Mixer B16 224 pytorch ✅ ❌ ✅ ✅ ❌ ✅ ✅ ❌ View Source
cv image cls MLP-Mixer Mixer B16 224 In21k pytorch ✅ ❌ ✅ ✅ ❌ ✅ ✅ ❌ View Source
cv image cls MLP-Mixer Mixer B16 224 Miil pytorch ✅ ❌ ✅ ✅ ❌ ✅ ✅ ❌ View Source
cv image cls MLP-Mixer Mixer B16 224 Miil In21k pytorch ✅ ❌ ✅ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls MLP-Mixer Mixer B32 224 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls MLP-Mixer Mixer Github pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source
cv image cls MLP-Mixer Mixer L16 224 In21k pytorch ✅ ❌ ❌ ❌ ✅ ✅ ❌ ❌ View Source
cv image cls MLP-Mixer Mixer L32 224 pytorch ✅ ❌ ✅ ✅ ✅ ✅ ✅ ❌ View Source

Contributors

vvukomanTT
Assets 5
Loading