Skip to content

v1.4.0

Choose a tag to compare

@Alberto-Codes Alberto-Codes released this 01 Apr 19:41
05a475e

1.4.0 (2026-04-01)

Features

  • kv-cache: add asymmetric K/V compression (k_bits/v_bits) (#59) (cf7e45e)

Bug Fixes

  • verify: require --k-bits and --v-bits together (cf7e45e)
  • vllm: validate TQ4_K_BITS/TQ4_V_BITS env vars (cf7e45e)

Documentation

  • experiments: add Exp 025-027 asymmetric quality matrix and serving (cf7e45e)
  • experiments: end-to-end vLLM serving benchmarks (Exp 029) (#62) (79c943c)
  • experiments: validate decode buffer OOM fix on 3 models (Exp 028) (#61) (509782a)