Skip to content

v0.11.0: add Qwen3.6 to the model catalog

Choose a tag to compare

@Helldez Helldez released this 19 Jul 08:12

Adds Qwen3.6-35B-A3B (arch qwen35moe) as a supported, one-tap model — a hybrid attention/SSM
MoE (256 experts, top-8, 41 blocks) whose routed experts stream through the existing qwen3moe path
unchanged. No engine change: the architecture is already in the registry.

Added

  • In-app one-tap download entry for Qwen3.6-35B-A3B (Q4_K_M, ~22.3 GB).
  • README: qwen35moe in Supported models + a Qwen3.6 benchmarks subsection.

On-device (model ~2× RAM)

Streaming with --overlap --dense-weights anon runs it stably where the mmap baseline collapses:

Config tok/s Flash/token Cache hit
mmap baseline (no streaming) 0.1
streamed, cache 3000 (lossless) 5.0 144 MiB 65%
streamed, cache 3000, k=6 (turbo) 5.8 91 MiB 68%

Figures are an indicative 96-token run, not yet the full 256-token best-of protocol.

Full changelog: v0.10.0...v0.11.0