Changes since v0.8.0:
Features
- R-B W4A8-FP8 tile — scale-folded e4m3 LUT loader, k32 f8f6f4 vec_dot (one MMA where int8 issues two), plain process_tile + kernel + launcher; BW24_MMQ_F8F4 seam + f8f4-check gate bin
- directory bulk-extraction mode + bf16 hidden dumps
- p3-agentic-long-v3 — real well-formed payload (hqmtp pe3: CPython selectors.py + real traceback) replaces the malformed-glue v1; 9B sampled audit coherent (58% acc, 158 tok/s @0.7)
- sampled mode + FRSPEC_TRIM — d2t scatter residual, trimmed-idx q gathers
- sampled speculative decoding — rejection-sampling verify (eager path), gates green
- BW24_REPLAY_HDUMP — stream pre-norm trunk hiddens + bg meta
- sampled-spec piece A complete — Engine methods + sample-check gate ALL GREEN
- sampled-spec piece A — Philox4x32-10 + Gumbel-max perturb, softmax-prob gather, residual/categorical sampler kernels (fatbin registered)
- f8f4 tile piece 1 — e4m3 activation quantize (d4-twin, cvt.e4m3x2) + plain-kind f8f6f4 MMA primitive + ABI size helpers
- mixed e4m3xe2m1 f8f6f4 probe BIT-EXACT at full 381 TFLOP/s — Probe 0 closed, R-A GO
- BW24_CHAT=1 chat-template wrapping (run-gen contract) — needed for the p3 re-measurement protocol
- mixed e4m3xe2m1 mxf8f6f4 probe (assembles; rate+correctness pending GPU) + design route ladder from form-matrix
Documentation
- sampled-spec implementation map — code anchors, Gumbel-max via device-argmax reuse, residual-sampling plan, gate ladder
- speculative decoding evaluation protocol survey (greedy degeneration)
- sampled-spec arc — owner decision, scope + new gate class
- piece-2 vec_dot/loader twin analysis — MMA halving, dA deletion, remaining port list
- route decision — R-B primary (8.5% adjacent-scale equality kills R-A's fast path; fold keeps per-16 granularity, simpler tile)
- R-A implementation spec — in-loop container build (VRAM law), cvt.e2m3x2 scale-fold recode, plain f8f6f4 e2m1xe4m3 MMA, gate plan
- FLAGS — KV_K fp8 flip-blocked (flat e2e + 9B ST spec self-consistency FAIL)
- prefill arc design — W4A8-FP8 via mxf8f6f4 block-scale MMA (native e2m1 weights x e4m3 acts), probe-0 plan
- board caveat — p3 spec column degeneration (symmetric both engines), per text audit
- HANDOVER — measurement protocol shift: llama win marked for Qwen models, internal A/B from here
Boards + reproduction artifacts: https://huggingface.co/Avifenesh/bw24-bench · full experiment log in research/tune-data/