Repository navigation
dstar 1.0: Qwen3.8-Flash-Next and DeepSeek V4 Flash on Apple Silicon
Prebuilt ds4 for Apple Silicon Macs (macOS 15 or newer) with the dstar launcher. Nothing to compile.
curl -fsSL https://raw.githubusercontent.com/paperniuk/ds4/m1-flash-next/install.sh | bash
dstar doctor # what your Mac fits
dstar pull # Qwen3.8-Flash-Next Q2_0, the MTP block, the vision encoder (67 GB)
dstar serve # OpenAI/Anthropic compatible server on http://127.0.0.1:8010/v1
dstar opencode # provider block for OpenCode
Other quants and models: dstar pull --quant iq3, dstar models, dstar serve deepseek or dstar serve /path/to/model.gguf. A model larger than the RAM streams from the SSD.
Measured on an M1 Max 64 GB with MTP: Qwen3.8-Flash-Next Q2_0 decodes at 44 tok/s at 4K, 38.8 at 256K and 35.4 at 398K, prefill 330 to 290 tok/s. IQ3_XXS: 35.2 to 31.7 tok/s up to 259K. DeepSeek V4 Flash Q2 streamed from the SSD: 12 to 9 tok/s up to 127K.
Only the M1 Max has been tested. M2 to M5 run the same code; reports from other chips are welcome (dstar doctor plus one dstar chat run).
Contents: ds4, ds4-server, dstar, download_model.sh, the Metal shaders, LICENSE. Built from 4997d51. Check the download against the attached .sha256.
Unofficial fork of antirez/ds4 for Apple Silicon. The quants are by ISTA-DASLab.