Skip to content

Add M2 Ultra (192 GB) benchmark - #88

Merged
antirez merged 1 commit into
antirez:mainfrom
timtan:bench-m2-ultra
May 12, 2026
Merged

Add M2 Ultra (192 GB) benchmark#88
antirez merged 1 commit into
antirez:mainfrom
timtan:bench-m2-ultra

Conversation

@timtan

@timtan timtan commented May 12, 2026

Copy link
Copy Markdown
Contributor

Thanks for the awesome work. here is the benchmark for my M2Ultra.

Hardware: Apple M2 Ultra, 24 cores (16P + 8E), 192 GB unified memory. Metal backend, IQ2XXS w2Q2K Q8 imatrix GGUF.

Ran the command from speed-bench/README.md:

./ds4-bench -m ds4flash.gguf --prompt-file speed-bench/promessi_sposi.txt \
  --ctx-start 2048 --ctx-max 65536 --step-incr 2048 --gen-tokens 128 \
  --csv speed-bench/m2_ultra.csv

Then:

python3 speed-bench/plot_speed.py speed-bench/m2_ultra.csv --title "M2 Ultra t/s"

Range across 32 frontiers: prefill 411 → 270 t/s, gen 23.2 → 20.4 t/s. Prefill consistently higher than M4 Max at every context; gen slightly lower (more GPU cores, lower per-core clock).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@antirez
antirez merged commit 3630e64 into antirez:main May 12, 2026
@timtan
timtan deleted the bench-m2-ultra branch May 12, 2026 10:39
hexxyan pushed a commit to hexxyan/ds4 that referenced this pull request May 27, 2026
usrlocalben pushed a commit to usrlocalben/ds4 that referenced this pull request Jun 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants