Skip to content

MLX libraries 0.32.5-0f4740d

Choose a tag to compare

@localkin localkin released this 07 Nov 04:20

The MLX libraries kinfer's MLX backend runs on. kinfer downloads this once, the first time it serves an MLX model (a directory of safetensors), checks it against the sha256 it pins, and keeps it in ~/.kinfer/mlx/0.32.5-0f4740d. Nothing here is needed for GGUF models, and nobody needs to download it by hand.

This MLX is not a release of MLX's: it is commit 0f4740d (2026-10-27), as MLX's own CI built it that night (Release build, artifact backend-metal-macOS-ARM64). It has the kernels for quantized matrix products of six to sixteen rows (ml-explore/mlx#4712) that a pass checking MTP drafts is, which 0.32.4 has not; on a MacBook Pro (M5 Max), Ollama's qwen3.8:27b-mlx drafting five tokens a step went from 67.4 to 72.5 tok/s on average. It is the MLX Ollama 0.40.15 ships.

file from
libmlx.dylib, libjaccl.dylib, mlx.metallib the macOS 26 wheel of that build, mlx_metal-0.32.5-py3-none-macosx_26_0_arm64.whl
libmlxc.dylib ml-explore/mlx-c 0.8.0 (a26f2d5), built against it with a macOS 26.2 deployment target and rpath @loader_path, with one line changed: MLX took a sliding window in scaled_dot_product_attention before mlx-c followed, so mlx-c passes -1, none, and its own API is as it was
LICENSE-mlx, LICENSE-mlx-c both MIT

Needs macOS 26.2 or later on Apple silicon. Built by scripts/mlx-libs.sh.

kinfer-mlx-0.32.5-0f4740d-darwin-arm64.tar.gz sha256 561234c600f4dc81cf13a44f13ca7b1354d6316abd5631cbf3992159191c3d45, 78,835,850 bytes