Skip to content

v0.7.13

Choose a tag to compare

View all tags
@Hmbown Hmbown released this 02 Feb 22:38
· 90 commits to main since this release
v0.7.13
2a48363

What's New

Added

  • GLM model detection in moe_mlp pattern, with opt-in fused SwiGLU via ZMLX_GLM_FUSED_SWIGLU env var
  • Experimental MoE stream pool: ZMLX_MOE_STREAMS=N for multi-stream expert dispatch
  • Kernel correctness tests covering bits, quant, image, indexing, fused_moe, and optimizers

Fixed

  • Numerically stable sigmoid: kk_sigmoid uses abs+branch to avoid overflow on large negative inputs
  • SwiGLU native dtype: forward/backward kernels use native dtype with kk_sigmoid helper
  • mypy stream type errors in moe_mlp.py (DeviceType → Device)

Changed

  • GLM auto-excluded: moe_mlp and swiglu_mlp excluded for GLM models (token fidelity failure)
  • README polish, gitignore cleanup

Full Changelog: v0.7.12...v0.7.13

Assets 2
Loading