Skip to content

v0.8.0

Latest

Choose a tag to compare

@github-actions github-actions released this 09 Jul 13:32

Changes since v0.7.0:

Performance

  • BW24_PP_PIPE=2 — 2-CTA/SM occupancy variant of the W4A8 MMQ pipe (WASH, default OFF)

Features

  • load safetensors HF checkpoints (directory model paths)
  • per-burst spec acceptance telemetry
  • accept HF safetensors dirs + NV-27B ST config sweep
  • teacher-forced replay acceptance — fixed-corpus MTP head metric (hqmtp)
  • CORPUS_DIR knob — save every prompt payload sent during acceptance runs
  • compressed-tensors NVFP4 arm + modelopt gates green
  • full-precision loader mode + oracle-path spec + acceptance battery
  • plain-decode forward wiring + mmap spill tier for the Q4_K repack dir

Fixes

  • gate hard-fails only on bg/pos mismatch; slot diff = reported noise floor
  • strip diff3 base markers leaked into rig5090.jsonl by merge resolution
  • accept HF safetensors dirs — skip GGUF weight-oracle sections instead of crashing
  • gate semantics — bg exact, drafts <=1% chunk-FP-order slack
  • BF16 embed device-gather + chunked bf16 linear — the spec path fits 24GB

Documentation

  • Hy3 phase-2 spill-tier tuning plan (lever list + measurement order)
  • FLAGS.md PP_FP8 row — local verification landed (+5.3% pp1855 NV-27B)
  • HANDOVER — ST spec lanes merged, disputed OOM claim flagged, board pending
  • FLAGS.md default-flip sync (SPEC_M2/FUSED_T/FA_V3 to rollback seams) + evidence discipline in CLAUDE.md
  • quant scope law (NVFP4 + full-prec only) + board policy (best-vs-best head-to-head, both containers until the choice)
  • readability + consistency pass across public docs
  • de-duplicate — numbers live once in the generated tables; prose explains without re-quoting; known-gaps and safetensors sections condensed
  • format direction — both GGUF+ST tuned, ST preferred (gguf = extra step, not default)
  • dual-shape directive — research platform; MTP-heal protocol queued next (9B bf16 acceptance ceiling vs NVFP4 hit)
  • box retired after w4a8v2 lands — local-only from here

Boards + reproduction artifacts: https://huggingface.co/Avifenesh/bw24-bench · full experiment log in research/tune-data/