Skip to content

v1.6.1

Latest

Choose a tag to compare

@github-actions github-actions released this 08 Aug 16:01
· 7 commits to main since this release

Fixed

  • Fused expert shape derivation no longer treats an even Qwen expert count
    as DeepSeek dual w1+w3 gate concat. Multiplicity is taken from
    per-index membership in the fused member list (DeepSeek gate still uses
    multiplicity 2).
  • fused_expert_module skips integrated mtp.* experts, matching
    fused_expert_tensor_target, so the quant predicate does not invent
    mtp.*.switch_mlp.* modules for byte-preserved MTP sidecars.
  • HyperConnection / HyperHead learnable .scale paths no longer expand to
    .scales aliases (avoids ambiguous converted-tensor binding).
  • Qwen exact MTP benchmark profile fails closed when the profile contract is
    not met (no silent mismatch).

Notes / operators

  • Patch over v1.6.0 DeepSeek V4 development convert support. No migration for
    existing non-DeepSeek artifacts.
  • DeepSeek convert still needs an mlx-lm build with deepseek_v4; packs
    remain development evidence only.