Repository navigation
0.92
Delta Inference Engine 0.92
New: pictures (off by default). Double-click Enable Pictures.bat (or set DS41_VISION=cpu) and restart, then
attach a picture in the chat page (or paste or drop it), or send one through the OpenAI or Anthropic API, and DeepSeek
sees it, with DeepSeek's own vision tower. The encoder runs on the CPU, so it takes no VRAM: a 1024x701 photo encodes
in about 8 s. Turning it on downloads the vision file (0.97 GB, from the default model's repository, SHA-256-checked)
and PyTorch's CPU build (124 MB).
Fixed: the model setup failed at its last step with the prebuilt engine. The drafter step needed a Python package
(gguf) that only a source build brought along, so a normal install stopped with "No module named 'gguf'" after the
366 GB download, and the server never started. The package is now installed with the others; a .venv from an
earlier version gets it at the next start. The drafter is also built before the big download now, so a problem there
shows up in minutes, not hours.
Folders with any name. The engine could not open its files when the project or model folder's path had a letter
outside A-Z: a Windows user name with an accent (C:\Users\José\...), or one in Cyrillic, Thai, Chinese and so on.
It now opens them (Windows 10 version 1903 or newer). If your install is in such a folder, Start DeepSeek.bat
offers this release's engine by itself. Other installs keep working with 0.91's engine and need no new download.
The engine's output is unchanged: its logits on a 4K-token prompt are identical to 0.91's.
Clearer before anything is downloaded:
- A GTX 10 series card (or older) is named as too old: CUDA 13 runs on RTX 20 / GTX 16 and newer. Before, the
launcher only asked for a newer driver, which does not help. - Under 12 GB of VRAM, or under 128 GB of RAM, a note says so before the download offer.
- Under 14 GB of VRAM the drafter is not set up, since the launcher does not use it there. If only the drafter is
missing, answering N starts DeepSeek without it.
Fixed and changed:
- A cancelled turn keeps the conversation's cache. When an agent tool stops a turn and sends the conversation again,
DeepSeek no longer reads all of it from the start: a 9,566-token conversation took 16.8 s before, now 0.5 s. (From
upstream Xolotl.) - A folder whose name has parentheses, such as
delta-inference-engine-main (1)from a second ZIP download, stopped
Start DeepSeek.batwith "... was unexpected at this time." START-HERE.bat,SETUP.batandUPDATE.batwere upstream Strata's and set up a different model. They now start
DeepSeek, openChoose Model.bat, and update this project.- The engine download is checked against the release's
SHA256SUMS.txtbefore it is unpacked. - The port is a setting (
DS41_PORTinds41-paths.bat). A port that is already in use, and an engine that stops
while starting, now get a plain message instead of a Python traceback. - The chat page is Delta's: name, logo, and the model that is actually loaded (a GSQ or Unsloth pick showed as the
default before).
New: Start DeepSeek (debug).bat. If something goes wrong, run this instead of Start DeepSeek.bat. It checks
the PC and the install, runs DeepSeek in a second window with all of its output saved, and when you close that window
it packs everything into one zip (logs\debug-<time>.zip) to attach to an issue. The zip holds no prompts or
answers, and your Windows user name is replaced by <user>.
Tested for this release:
- A full install on a second PC (GTX 1070, Japanese Windows), which found the drafter problem above.
- An hour of mixed requests: tool calls, JSON schema, parallel and cancelled requests, new long documents and a
growing conversation. 400 requests, no failures, memory flat after the conversation cache filled. - A ZIP download in a folder with spaces and parentheses, a folder with an accented name, an upgrade from 0.9, and the
debug launcher on a broken install, closed with Ctrl+C and closed by its window.
Measured (see the README): with 128 GB of RAM, Unsloth's UD-IQ1_S writes at 37.5 tok/s against 33 for the default,
at 2 points less agreement with DeepSeek, so it is the pick for 128 GB. It also reads long prompts about 13% faster.
Upgrading from 0.91: git pull in the folder (or download the new ZIP and unpack it over the old one), then
double-click Start DeepSeek.bat. It installs what the new version needs first. Your model files stay as they are.
Downloads: Start DeepSeek.bat picks the right zip for your CPU by itself.
| File | CPU |
|---|---|
build-ds41-portable.zip |
AVX2: Intel 2013+ (Haswell on), every AMD Ryzen / Threadripper / EPYC |
build-ds41-compat-avx.zip |
AVX without AVX2 (Sandy / Ivy Bridge) |
build-ds41-compat.zip |
anything x86-64 with SSE4.2 (slower) |
SHA-256 checksums are in SHA256SUMS.txt. The zips include NVIDIA CUDA runtime libraries (cudart, cublas,
cublasLt), redistributed under the NVIDIA CUDA Toolkit EULA.