Skip to content

v0.1.4

Choose a tag to compare

View all tags
@infosave2007 infosave2007 released this 07 Jul 17:48
v0.1.4
faf9aae

CMF v0.1.4

The full HF → .cmf conversion now lives in one place — cortiq — so anything downstream (like a gateway) just calls the binary.

Added

  • cortiq convert --model <owner/name> accepts a Hugging Face repo id and downloads it (config + tokenizer + safetensors) before converting. --hf-token for gated/private repos. Cache: ~/.cache/cortiq/hf.
  • Parallel downloads — weight files are pulled in concurrent 32 MiB byte-range chunks over reused connections (saturates bandwidth for single-file and sharded models). Tunable via CORTIQ_HF_THREADS (default 8).

Example: cortiq convert --model Qwen/Qwen2.5-0.5B-Instruct --quant q8 --output model.cmf — no Python.

Assets 2
Loading