Skip to content

v0.1.3

Choose a tag to compare

View all tags
@infosave2007 infosave2007 released this 07 Jul 17:08
v0.1.3
ef6d832

CMF v0.1.3

Added — native Rust converter (no Python)

  • cortiq convert --model <hf-dir> --quant q8|q4|f16 --output model.cmf converts a Hugging Face checkpoint (config.json + *.safetensors + tokenizer.json) to .cmf entirely in Rust — no numpy, no torch. It reads safetensors, quantizes with f16-rounded row scales, embeds the tokenizer + chat template, and writes via cortiq_core::CmfModel::write.
  • Output is generation-identical to the reference Python converter on standard dense transformers (qwen2 / qwen3 / llama / mistral-style). MoE / linear-attention models still use the Python path.

Install / update: cargo install cortiq-cli

Assets 2
Loading