Model Zoo — models/
github: https://github.com/Asher-1/sam3-ggml
This directory holds ready-to-run GGUF models for sam3.cpp.
Each file name encodes three things:
<family>_<backbone/size>_<precision>.gguf
| Part |
Meaning |
sam3 / sam3-visual |
SAM 3 — ViT-32 backbone + text encoder + DETR detector (850M params) |
sam2 / sam2.1 |
SAM 2 / SAM 2.1 — Meta's Hiera-backbone segmentation models (visual only) |
tiny / small / base_plus / large |
Backbone size (39M / 46M / 81M / 224M params) |
f32 / f16 / q8_0 / q4_1 / q4_0 |
Weight precision (see Precision guide) |
Architecture lineage: this directory covers 2 architectures —
SAM 3 (sam3-*, sam3-visual-*) and the SAM 2 family
(sam2*, sam2.1*). There are no SAM 1 checkpoints (SAM 1 / ViT-B/L/H is a separate
architecture not shipped by this project). The SAM 2 family is visual-only
(points/box + tracking); SAM 3 full adds text-prompted detection (PCS):
type "cat" and get every cat in the image.
Quick pick
| You want… |
Pick |
| Text-prompted detection ("type cat, get every cat") |
sam3-f16.gguf (1.8 GB) or sam3-q8_0.gguf (1.1 GB) |
| Best visual quality-to-speed balance on GPU |
sam2.1_hiera_base_plus_f16.gguf (156 MB) |
| Fastest interactive point/box segmentation on any device |
sam2.1_hiera_tiny_q4_0.gguf (23 MB) |
| Best segmentation quality |
sam2.1_hiera_large_f16.gguf (431 MB) or _q8_0 (231 MB) |
| Debugging / numerical reference (never for deployment) |
sam2.1_hiera_tiny_f32.gguf |
Model files
Sizes below are the actual .gguf files in this directory. Latency is a
single-image PVS run (encode + segment) at 1008×1008 on RTX 3060 CUDA,
point (315,250) on tests/cat.jpg. The current SAM 3 F16 result uses
sam3_encode_image_pvs(), 2 warmups and 7 timed runs (p50); the remaining
rows are the earlier all-model snapshot. score = mask IoU confidence.
SAM 3 (850M params — ViT-32 backbone + text encoder + DETR decoder)
| File |
Size |
Load |
Encode |
Segment |
Total |
score |
sam3-f32.gguf |
3.3 GB |
3.3 s |
4.2 s |
0.21 s |
7.7 s |
0.953 |
sam3-f16.gguf |
1.8 GB |
0.81 s |
0.566 s |
0.032 s |
1.41 s |
0.953 |
sam3-q8_0.gguf |
1.1 GB |
1.4 s |
3.5 s |
0.20 s |
5.1 s |
0.953 |
sam3-q4_1.gguf |
730 MB |
1.1 s |
3.6 s |
0.21 s |
4.9 s |
0.937 |
sam3-q4_0.gguf |
707 MB |
1.5 s |
3.6 s |
0.25 s |
5.3 s |
0.915 |
Best for: text-prompted detection (PCS) + point/box segmentation (PVS) +
video tracking in one model. The full SAM 3 is the only family here that
supports text prompts; the visual path matches sam3-visual exactly.
SAM 3 Visual (no text encoder — PVS + tracking only)
| File |
Size |
Load |
Encode |
Segment |
Total |
score |
sam3-visual-f16.gguf |
902 MB |
1.5 s |
2.3 s |
0.22 s |
4.0 s |
0.952 |
sam3-visual-q8_0.gguf |
494 MB |
0.7 s |
2.2 s |
0.22 s |
3.1 s |
0.953 |
sam3-visual-q4_1.gguf |
303 MB |
0.7 s |
2.2 s |
0.21 s |
3.1 s |
0.937 |
sam3-visual-q4_0.gguf |
276 MB |
0.6 s |
2.2 s |
0.23 s |
3.0 s |
0.915 |
Best for: SAM 3-quality segmentation without the text encoder — half the
size and ~40% faster than full SAM 3. Same PVS + tracking capabilities as
sam2.1_hiera_base_plus but with the stronger SAM 3 backbone.
SAM 2 (Hiera backbone, visual only)
| File |
Size |
Load |
Encode |
Segment |
Total |
score |
sam2_hiera_tiny_f16.gguf |
76 MB |
0.79 s |
1.43 s |
0.37 s |
2.6 s |
0.959 |
sam2_hiera_tiny_f32.gguf |
149 MB |
0.90 s |
0.98 s |
0.20 s |
2.1 s |
0.959 |
sam2_hiera_tiny_q8_0.gguf |
41 MB |
0.39 s |
0.82 s |
0.16 s |
1.4 s |
0.959 |
sam2_hiera_tiny_q4_1.gguf |
25 MB |
0.35 s |
0.81 s |
0.16 s |
1.3 s |
0.930 |
sam2_hiera_tiny_q4_0.gguf |
23 MB |
0.43 s |
0.83 s |
0.17 s |
1.4 s |
0.933 |
sam2_hiera_base_plus_f16.gguf |
156 MB |
0.82 s |
1.22 s |
0.20 s |
2.2 s |
0.957 |
sam2_hiera_base_plus_f32.gguf |
309 MB |
0.97 s |
1.22 s |
0.17 s |
2.4 s |
0.957 |
sam2_hiera_base_plus_q8_0.gguf |
84 MB |
0.93 s |
1.57 s |
0.28 s |
2.8 s |
0.955 |
sam2_hiera_base_plus_q4_1.gguf |
51 MB |
0.73 s |
1.16 s |
0.18 s |
2.1 s |
0.954 |
sam2_hiera_base_plus_q4_0.gguf |
46 MB |
0.65 s |
1.19 s |
0.22 s |
2.1 s |
0.952 |
sam2_hiera_large_f16.gguf |
430 MB |
1.42 s |
1.47 s |
0.25 s |
3.1 s |
0.909 |
SAM 2.1 (improved SAM 2, same Hiera architecture)
| File |
Size |
Load |
Encode |
Segment |
Total |
score |
sam2.1_hiera_tiny_f32.gguf |
149 MB |
0.78 s |
1.11 s |
0.21 s |
2.1 s |
0.943 |
sam2.1_hiera_tiny_f16.gguf |
76 MB |
0.60 s |
1.03 s |
0.23 s |
1.9 s |
0.943 |
sam2.1_hiera_tiny_q8_0.gguf |
41 MB |
0.62 s |
1.11 s |
0.24 s |
2.0 s |
0.945 |
sam2.1_hiera_tiny_q4_1.gguf |
25 MB |
0.62 s |
0.95 s |
0.19 s |
1.8 s |
0.956 |
sam2.1_hiera_tiny_q4_0.gguf |
23 MB |
0.73 s |
1.13 s |
0.25 s |
2.1 s |
0.927 |
sam2.1_hiera_small_f32.gguf |
176 MB |
0.69 s |
0.88 s |
0.18 s |
1.8 s |
0.945 |
sam2.1_hiera_small_f16.gguf |
90 MB |
0.75 s |
0.99 s |
0.19 s |
1.9 s |
0.945 |
sam2.1_hiera_small_q8_0.gguf |
48 MB |
0.61 s |
0.96 s |
0.19 s |
1.8 s |
0.944 |
sam2.1_hiera_small_q4_1.gguf |
30 MB |
0.72 s |
1.27 s |
0.19 s |
2.2 s |
0.947 |
sam2.1_hiera_small_q4_0.gguf |
27 MB |
0.62 s |
1.11 s |
0.19 s |
1.9 s |
0.949 |
sam2.1_hiera_base_plus_f32.gguf |
309 MB |
0.99 s |
1.25 s |
0.21 s |
2.5 s |
0.953 |
sam2.1_hiera_base_plus_f16.gguf |
156 MB |
0.71 s |
1.09 s |
0.18 s |
2.0 s |
0.953 |
sam2.1_hiera_base_plus_q8_0.gguf |
84 MB |
0.79 s |
1.40 s |
0.21 s |
2.4 s |
0.954 |
sam2.1_hiera_base_plus_q4_1.gguf |
51 MB |
0.74 s |
1.44 s |
0.24 s |
2.4 s |
0.944 |
sam2.1_hiera_base_plus_q4_0.gguf |
46 MB |
0.79 s |
1.34 s |
0.23 s |
2.4 s |
0.936 |
sam2.1_hiera_large_f32.gguf |
857 MB |
1.42 s |
1.57 s |
0.18 s |
3.2 s |
0.940 |
sam2.1_hiera_large_f16.gguf |
431 MB |
1.00 s |
1.29 s |
0.17 s |
2.5 s |
0.940 |
sam2.1_hiera_large_q8_0.gguf |
231 MB |
0.76 s |
1.44 s |
0.19 s |
2.4 s |
0.938 |
sam2.1_hiera_large_q4_1.gguf |
138 MB |
0.75 s |
1.68 s |
0.23 s |
2.7 s |
0.928 |
sam2.1_hiera_large_q4_0.gguf |
124 MB |
0.77 s |
1.49 s |
0.23 s |
2.5 s |
0.900 |
Charts
Precision guide
| Precision |
Relative size |
Quality |
Use |
f32 |
1.0× |
reference |
Debugging, numerical checks only — never deploy |
f16 |
0.5× |
≈ f32 |
Recommended default — near-lossless, half the size |
q8_0 |
0.25× |
very close to f16 |
Big models (large/sam3) when f16 is too big |
q4_1 |
~0.14× |
good (retains scale + offset) |
Aggressive size cuts with better fidelity than q4_0 |
q4_0 |
~0.13× |
acceptable for interactive use |
Smallest files; quality gap is visible on thin structures |
Size selection guide
| Need |
SAM 3 |
SAM 3 Visual |
base_plus |
tiny |
| Text prompts (PCS) |
Yes |
- |
- |
- |
| PVS + tracking |
Yes |
Yes |
Yes |
Yes |
| Encode latency (RTX 3060) |
0.566 s (F16 PVS) |
snapshot: 2.2 s |
~1.1–1.6 s |
~0.8–1.1 s |
| Size (f16) |
1.8 GB |
902 MB |
156 MB |
76 MB |
- SAM 2 vs SAM 2.1: prefer 2.1 for new projects (better training data and
tracking; same architecture, same speed, same sizes).
- Video tracking: tiny is the practical choice for interactive playback on
CPU; larger backbones work well on GPU.
- Point/box (PVS) + tracking work on every model here; text-prompted
detection (PCS) requires a SAM 3 checkpoint (the sam3-* files above).
