Skip to content

v0.53.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 31 Jul 06:31
v0.53.0
7b9d3a5

Changes since v0.52.0:

Performance

  • 31B joins the Q4_0 f16 mirror lane — H100 prefill 4765 -> 7589 tok/s (1.59x, full-trunk mirror)

Boards + reproduction artifacts: https://huggingface.co/Avifenesh/bw24-bench · full experiment log in research/tune-data/

Assets 6
Loading