Skip to content

vMLX v1.3.0

Choose a tag to compare

View all tags
@jjang-ai jjang-ai released this 20 Mar 19:11
· 219 commits to main since this release
v1.3.0
5b225ec

vMLX v1.3.0 — Hybrid SSM Cache, Nemotron, Reasoning Fixes

Critical Bug Fixes

  • Metal crash on disk cache store (P0) — pre-materialize arrays on main thread before background write, preserves bfloat16
  • Paged cache layer mismatch (P1) — block reuse now checks cumulative SSM state for last-block position
  • Hybrid cache reconstruction (P1) — text scheduler applies _fix_hybrid_cache (was VLM-only)
  • Fresh-cache fallback — detects empty cache (offset=0), treats as miss instead of silent corruption
  • Reasoning OFF not working — Nemotron, MiniMax, and all models now respect thinking toggle
  • Image generation interval leak — clearInterval in finally block
  • JANG VLM config detection — uses _find_config_path() instead of hardcoded path

New

  • Nemotron-H JANG support — gate dequant (8→2 bit), fc1/fc2 rename, MTP filter (42GB GPU, 46 tok/s)
  • Hybrid SSM full cache — prefix, paged, and disk caching work with Qwen3.5-A3B, Nemotron-H
  • Session status banners — loading, sleeping, stopped states in chat
  • Smooth token streaming — renderer-side typewriter animation (rAF) for main content and reasoning
  • ReasoningBox performance — plain text during streaming, markdown parse only when done

Removed

  • All think-completion seed injection code
  • Dead STREAM_THROTTLE_MS constant and throttle check
  • Dead _is_vlm_config() function

Quality

  • 7-section 76-check audit: 0 FAIL across reasoning ON/OFF (11 model types), Anthropic API, OpenAI API, streaming pipeline, cache system, JANG/Nemotron engine, sleep/wake/JIT
  • 2021 Python + 1545 panel = 3566 tests, 0 regressions

Install

Download the DMG below and drag vMLX to Applications.

Engine: pip install --upgrade vmlx

Full Changelog: v1.2.9...v1.3.0

Assets 3
Loading