v0.13.3

What's new in v0.13.3

Rapid-MLX 0.13.3

Rapid-MLX 0.13.3 brings GLM-5.3-Flash to the production serving path, makes
hybrid multimodal conversations reuse eligible text prefixes, and improves the
Desktop workflows around navigation, video generation, streaming output, and
failure recovery.

Highlights

GLM-5.3-Flash support

Use glm5.3-flash-4bit from the CLI, OpenAI-compatible server, or Desktop. The
release includes the processor and runtime compatibility required by the
checkpoint, preserves explicit image-channel layouts, rejects malformed media
before model execution, and keeps speculative decoding disabled because its
qualification run did not improve throughput.

On a 256 GB M3 Ultra, the qualified 4-bit checkpoint decoded a sustained
512-token response at a median 29.2 tok/s and used 165.4 GB of active MLX
memory. The alias therefore requires the 192 GB memory tier. The README's
benchmark link records the exact checkpoint revision, request payload, and
reproduction command.

Faster repeated work on hybrid vision models

Compatible text-only phases on a hybrid multimodal lane can reuse their text
prefix state instead of recomputing it. Cache identity includes the rendered
request and model state, while media-bearing requests continue through the
validated vision path. This improves repeated background and conversation work
without treating an image request as a text-only cache hit.

Desktop workflow improvements

• A native command palette makes common actions available from the keyboard.
• Completed interactions can expose a lightweight feedback entry, while a
  direct diagnostics shortcut makes failures easier to investigate.
• Model pickers remain scoped to the active task instead of leaking selection
  state across unrelated surfaces.
• Streaming Markdown presentation is smoother and remains live when a window
  is restored away from an attached display.

More resilient video and release workflows

Completed video jobs persist across server restarts, and clients can inspect
video capabilities before loading a model. Packaged Desktop builds can recover
the engine after a failed post-DMG installation. The merge lane also gains a
more reliable native-test bootstrap, dependency-bound evidence, and a faster
in-process accessibility journey without reducing required coverage.

Upgrade

pip install -U rapid-mlx

Homebrew follows the PyPI release through its normal autobump process. Desktop
users receive the signed and notarized update through the production appcast.

All changes

• fix: fail fast on invalid multimodal runtime (#2862) (6f3f65b)
• test(mac): sink slow-stream-stop, tool-loop-budget, math-rendering, restored-tools into swift test (#2869) (017a36c)
• chore: bump version to 0.13.3 (6e49780)
• docs: refresh recent large-model benchmarks (#2822) (4c03e3d)
• test(mac): sink the message-actions golden journey into swift test (#2855) (0e498ba)
• feat: add production-safe GLM-5.3-Flash support (#2792) (4acffa7)
• fix(ci): preserve mlx guard proof in merge batches (#2833) (75a78cb)
• perf(mllm): reuse text prefixes on hybrid vision lane (#2839) (e986665)
• feat(mac): add post-value feedback entry (#2790) (26b1634)
• feat(mac): add failure diagnostics shortcut (#2786) (a9ddb2c)
• feat(mac): add command palette (#2789) (894f50f)
• fix(ci): settle transcript before fresh-install baseline (#2821) (a0ed91c)
• fix(mac): scope model pickers to the active task (#2785) (68817d9)
• Persist completed video jobs across server restarts (#2794) (ce939da)
• fix(mac): smooth streaming Markdown rendering (#2280) (25a54b6)
• fix(ci): make native XCUITest bootstrap reliable (#2787) (7368ae2)
• Expose pre-serve video model capabilities (#2791) (a4ddc2c)
• fix: add post-DMG engine release recovery (#2332) (1852f33)

Community contributors

• @chen-yijiang — fix(mac): smooth streaming Markdown rendering

Install: brew upgrade rapid-mlx or pip install -U rapid-mlx==0.13.3 (or just rapid-mlx upgrade).