Skip to content

v0.2.0

Choose a tag to compare

@vcruz305 vcruz305 released this 01 Sep 05:54
· 40 commits to main since this release

First standalone release. Renamed from glm53_exl3_plugin 0.1.1 — identical behavior plus the package rename; the old import path remains as a deprecated shim.

Carried from 0.1.1:

  • Fused-MoE per-expert row cap raised (TEMP_ROWS_FUSED 128 → 2048), fixing the >163k-token prefill stall.
  • Non-routed layers delegate to a pack-declared source-format quant method (quantization_config.non_routed_quantization).