Skip to content

v0.3.0

Choose a tag to compare

@github-actions github-actions released this 08 Jul 18:21

Changes since v0.2.0:

Performance

  • full board 2026-07-09 — 35B spec p1/p2 flip positive (225/212 vs 215/208), spec board 8/9 above llama, plain 27B 1.10x/9B 1.08x/35B 1.02x
  • vendor llama Q8_0 int8-MMA MMQ (BW24_PP_Q8MMQ, 35B pp 1.30x)

Configuration

  • BW24_PP_Q8MMQ default ON — 35B pp 2456->3069 (+25%), 9B +12%; battery green (35B p1-p3 + 9B p2/p3 argmax MATCH, p4 OOM pre-existing both arms)

Documentation

  • scope law — this box only; M3 counts as its local number, other-box gains out of scope

Boards + reproduction artifacts: https://huggingface.co/Avifenesh/bw24-bench · full experiment log in research/tune-data/