Skip to content

V0.16.1 patch release

Latest

Choose a tag to compare

@chensuyue chensuyue released this 16 Oct 03:10

Highlights

  • fix: keep 0 in the range of GGUF asymmetric K-quant groups by @raashish1601 in #2438
  • fix: correct Q5_K GGUF packing by @raashish1601 in #2437
  • fix: keep make_q3_quants sums in sync with accepted levels by @raashish1601 in #2439
  • NeUQI grid search for optimized RTN (--enable_neuqi: joint asym scale/zp search, two-stage sym search, frozen-init anchor) by @avtc in #2341

What's Changed

New Contributors

Full Changelog: v0.16.0...v0.16.1