Skip to content

v0.1.6

Choose a tag to compare

@github-actions github-actions released this 07 Jul 18:44

CMF v0.1.6 — native GGUF importer + MoE

Added

  • cortiq import-gguf <file.gguf> --output model.cmf — a native Rust GGUF importer (F32 / F16 / Q8_0; llama / qwen2 / qwen3). It also reconstructs a Hugging Face tokenizer.json from the embedded ggml metadata, so the result is runnable. No Python. (K-quants Q4_K/Q5_K/Q6_K still use the Python importer.)
    • Validated: a qwen2 Q8_0 GGUF imports and generates identically to the HF-safetensors path.
  • Mixture-of-experts in cortiq convert — router + per-expert matrices are converted and the runtime dispatches the sparse FFN (qwen2-moe / qwen3-moe).

Note

  • Linear-attention (GatedDeltaNet, Qwen3.5) conversion still uses the Python path.

Prebuilt binaries are attached below. cargo install cortiq-cli.