v0.11.0: add Qwen3.6 to the model catalog
Adds Qwen3.6-35B-A3B (arch qwen35moe) as a supported, one-tap model — a hybrid attention/SSM
MoE (256 experts, top-8, 41 blocks) whose routed experts stream through the existing qwen3moe path
unchanged. No engine change: the architecture is already in the registry.
Added
- In-app one-tap download entry for Qwen3.6-35B-A3B (Q4_K_M, ~22.3 GB).
- README:
qwen35moein Supported models + a Qwen3.6 benchmarks subsection.
On-device (model ~2× RAM)
Streaming with --overlap --dense-weights anon runs it stably where the mmap baseline collapses:
| Config | tok/s | Flash/token | Cache hit |
|---|---|---|---|
| mmap baseline (no streaming) | 0.1 | — | — |
| streamed, cache 3000 (lossless) | 5.0 | 144 MiB | 65% |
| streamed, cache 3000, k=6 (turbo) | 5.8 | 91 MiB | 68% |
Figures are an indicative 96-token run, not yet the full 256-token best-of protocol.
Full changelog: v0.10.0...v0.11.0