Repository navigation
v0.39.0 - Exact FP16 packets save transport and footprint, not resident latency
Pre-releasev0.39.0 - Exact FP16 packets beat streaming, not warm residency
Third of the authorized four-to-eight deliveries. The28.474-second screen passes
FP16 faithfulness/resources/transport/footprint and fails resident-speed. All
checked logits are bit-identical;48 scored tokens per condition match.
Direct FP16 streaming:38,654,705,664 B /3.195469s. Packets:2,161,006,344 B /
1.526528s, saving94.4095% H2D and52.2284% wall. Both offloaded conditions peak at
2,677,116,928 sampled GPU bytes versus resident3,413,217,280 B (21.5662% lower).
This memory saving belongs to offloading, not packet-only residency. Resident
FP16 takes0.382103s and already fits; packets do not beat its warm latency.
Protocol,
results and inspirations,
compact receipts,
source freeze.
Known three32-token prefixes,16-token continuations, declared separate warmups,
FP16 KV and same-precision references. All original-layout host copies, device/
pinned buffers, resource sampling and records are charged. Reference GPU startup
means no CPU-first capacity claim; not FP32-quality preservation or optimized-Q4
competitiveness. Resident-first phase order remains a limitation.
650 CPU tests, unchanged prior raw replays, source review and exact repeat audit
pass. Raw precision-v039-raw.zip:36,303,659 B,155 members, SHA256
b876cb8a0a70ee59b0d636a06c5cbe91b4df0c101f2c088d938b43bac5d564e3.
Archive restored/hash checked; no checkpoint weights redistributed. Final clean-tip
full-suite validation attaches separately.
Complete #54, not
milestone10.
Physical/footprint gates admit a separately frozen short larger sparse-model
capacity experiment; resident-speed failure is preserved. No long matrix/native
pivot follows, and the optimized-Q4 frontier remains open.