Skip to content

Delta Inference Engine v0.9

Choose a tag to compare

View all tags
@musicurgy musicurgy released this 26 Oct 14:41
· 245 commits to main since this release
0.9
3f08326

DeepSeek-V4.1-Flash-1017 on one NVIDIA GPU, natively on Windows.

You don't need to download these by hand: Start DeepSeek.bat picks the right engine for your CPU and downloads it on the first start.

File For
build-ds41-portable.zip CPUs with AVX2 - Intel 2013+ (Haswell), any AMD Ryzen / Threadripper / EPYC. Almost everyone.
build-ds41-compat-avx.zip CPUs with AVX but not AVX2 (Sandy / Ivy Bridge Xeons)
build-ds41-compat.zip Older CPUs (SSE4.2 only)

All three: NVIDIA RTX 20 / 30 / 40 / 50, driver 580 or newer. SHA256SUMS.txt has the checksums.

Measured on an RTX 3090 + 192 GB RAM: ~41 tok/s writing, ~610 tok/s reading long prompts. 12 GB cards and up, 128 GB RAM and up - see the README.

Assets 6
Loading