Skip to content

v0.1.9

Choose a tag to compare

View all tags
@github-actions github-actions released this 08 Jul 06:11
v0.1.9
2932915 
v0.1.9 — native v-bit (variable-bit) quantization

- cortiq convert / import-gguf --quant vbit now encode the grouped variable-bit
  format natively in Rust: per-row bit-width (3-8, water-filled by log2 row
  amplitude toward a 4.25-bit budget), per-32-group f16 scale, MSB-first
  packing — byte-compatible with cortiq-core::dequant_vbit. Round-trip unit
  test + real-model convert->run verified (~40% smaller than q8, coherent).
- Only the GPTQ-calibrated v-bit variant (needs an activation Hessian) still
  uses the Python converter; the weight-only path is fully native.
Assets 6
Loading