Skip to content

v0.2.3

Choose a tag to compare

View all tags
@vcruz305 vcruz305 released this 02 Sep 17:52
· 34 commits to main since this release
v0.2.3
0f0208c

Dense EXL3 for non-routed linears (non_routed_exl3 layers map, mul1 codebook, mixed EXL3/BF16 shards), tools/dense_overlay.py, the bf16_as_stored policy for packs that keep dense weights BF16 (DeepSeek-V4-Flash on stock vLLM 0.28), and the mul1 marker constant fix. See CHANGELOG.md.

Assets 3
Loading