Skip to content

v0.1.5

Choose a tag to compare

View all tags
@infosave2007 infosave2007 released this 07 Jul 18:11
v0.1.5
6b20df1

CMF v0.1.5 — converter hardening

Added

  • cortiq convert --quant q8_2f — two-field (𝒲×θ) int8 that recovers most of the int8→fp16 quality gap at the same size.
  • Prebuilt cortiq binaries attached to this release (Linux x86_64, macOS arm64/x86_64) — use it with no Rust toolchain.
  • Converter round-trip tests (q8 / q8_2f / q4 + a tiny end-to-end) in CI.

Changed

  • Byte-faithful conversion: round-half-to-even quantization → weights byte-identical to the reference Python converter (286/290 tensors match; generation identical).
  • Lighter: input safetensors are memory-mapped and processed one tensor at a time — peak RAM ≈ the output, not the whole model.
  • Resilient downloads: each byte-range chunk retries with exponential backoff, with a live percentage.

cargo install cortiq-cli — or grab a binary below.

Assets 6
Loading