Skip to content

Basalt v0.3.2-prod1 (Windows x64, CUDA 13, sm_120)

Choose a tag to compare

@cfelicio cfelicio released this 11 Nov 15:32
· 141 commits to main since this release

Basalt v0.3.2-prod1 (Windows x64, CUDA 13, sm_120)

Clean, stable production release built on upstream v0.3.2 with 5 proven performance and stability optimizations for AMD Zen 3/4 + NVIDIA RTX 5070 Ti / Blackwell architectures:

  • CPU Zen 3/4 BMI2 AVX2 (aef4013): Vectorized bit unpacking and sign mask shifts behind a fast-pdep probe for CPU MoE expert execution (+15–20% CPU token rate).
  • CPU Expert Pool Lost-Wakeup Fix (2c896a3): Synchronizes worker completion barrier to eliminate intermittent thread pool jitter/stalls.
  • DeepSeek-V4.1 Batch Prefill for Incremental Reads >= 16 tokens (85bfa88): Accelerates multi-turn user conversation turns and tool calls from 15.5 t/s to 202.6 t/s (13x speedup).
  • DeepSeek-V4.1 2048 Prefill Chunk Cap on <= 16 GB GPUs (3579e89): Caps prefill chunks to 2048 on 16 GB cards, eliminating OOMs and keeping workspace to ~738 MiB.
  • DeepSeek-V4.1 Dynamic Beside Slots & 512 MiB Floor (ceee676): Reclaims freed prompt memory during decode (raising VRAM expert hit rate to 34.4%) while strictly preserving a 512 MiB Windows WDDM floor to prevent driver paging.
  • Windows Launcher & Dynamic Vision Fix (b620a71): Fixes vision dynamic mode translation and adds --config support to START-HERE.bat.