Skip to content

dstar 1.0: Qwen3.8-Flash-Next and DeepSeek V4 Flash on Apple Silicon

Choose a tag to compare

@paperniuk paperniuk released this 03 Oct 17:57
· 334 commits to m1-flash-next since this release

Prebuilt ds4 for Apple Silicon Macs (macOS 15 or newer) with the dstar launcher. Nothing to compile.

curl -fsSL https://raw.githubusercontent.com/paperniuk/ds4/m1-flash-next/install.sh | bash
dstar doctor     # what your Mac fits
dstar pull       # Qwen3.8-Flash-Next Q2_0, the MTP block, the vision encoder (67 GB)
dstar serve      # OpenAI/Anthropic compatible server on http://127.0.0.1:8010/v1
dstar opencode   # provider block for OpenCode

Other quants and models: dstar pull --quant iq3, dstar models, dstar serve deepseek or dstar serve /path/to/model.gguf. A model larger than the RAM streams from the SSD.

Measured on an M1 Max 64 GB with MTP: Qwen3.8-Flash-Next Q2_0 decodes at 44 tok/s at 4K, 38.8 at 256K and 35.4 at 398K, prefill 330 to 290 tok/s. IQ3_XXS: 35.2 to 31.7 tok/s up to 259K. DeepSeek V4 Flash Q2 streamed from the SSD: 12 to 9 tok/s up to 127K.

Only the M1 Max has been tested. M2 to M5 run the same code; reports from other chips are welcome (dstar doctor plus one dstar chat run).

Contents: ds4, ds4-server, dstar, download_model.sh, the Metal shaders, LICENSE. Built from 4997d51. Check the download against the attached .sha256.

Unofficial fork of antirez/ds4 for Apple Silicon. The quants are by ISTA-DASLab.