Skip to content

v0.36.0: FP16 access limits and six-release research findings

Pre-release
Pre-release

Choose a tag to compare

@displague displague released this 15 Sep 15:07
· 12 commits to main since this release

v0.36.0 - FP16 fits and matches tokens; first-use latency misses the gate

Sixth/final authorized delivery. The31.048-second screen is complete and audited.
Ordinary resident FP16 fits below4800MiB and matches ALL16 own-trajectory greedy
tokens. Its compound useful-access gate fails because the first episode takes
13.067s, above5s; the second takes0.062s. Preserve the first-use stall: no warmup
discard, repeat, relaxed threshold or attributed cause without profiling.

FP32 numerical fidelity separately fails: aligned full-logit relativeL2 ranges
0.000615--0.005117 against1e-5. IDs still match. This is numerical difference, not
demonstrated task-quality loss. Peak sampledGPU3,406,925,824 B; parameters
2,631,516,160 B and maximum FP16 KV4,521,984 B. All physical/state/resource audits
pass. Setup2.302s and constructionH2D2,631,516,160 B are charged separately; there
is no weight acquisition during generation.

Protocol,
results and inspirations,
six-release findings,
compact receipts,
source freeze.

The course's strongest result is the exact outgoing-weight packet loader on ReLU
OPT: v0.35 stays below4800MiB from CPU-only startup and saves93.65%H2D/72.16%wall
versus stronger contiguous FP32 streaming. FP16's observed capacity/token parity
and first-use stall do not establish uniquely enabled access or a paired warmed
speedup for packets. Known short prefixes, an imposed budget and small sample do
not qualify a larger checkpoint, task quality, long context or deployment.

622 CPU tests pass; exact second audit adds no inference. Final clean-tip full-suite
receipts are attached separately. Raw resident-v036-raw.zip:6,410,382 B,
115 members, SHA256 acbe26d172b01687a2cdaa7901e7d573a7b078696ddbd49cf68c1b4451e1730b.
Archive restored/hash checked; external references included, checkpoint weights not
redistributed. Earlier negative results and the first packet failure stay preserved.

Complete #51 and
the six requested releases, NOT milestone10.
No additional sweep, long matrix, model download or native pivot starts automatically.