Skip to content

v0.37.0 - Exact-row retention: 46% fewer transfers, slower generation

Pre-release
Pre-release

Choose a tag to compare

@displague displague released this 15 Sep 17:20
· 10 commits to main since this release

v0.37.0 - Exact row retention saves 46% transfers but loses latency

First of the newly authorized four-to-eight research deliveries. The34.209-second
screen completes with all checked logits bit-identical and all48 scored tokens
per condition matching. Faithfulness, memory and acquisition pass; runtime fails.

1024 retained outgoing rows per layer reduce weight-plus-index H2D from
4,317,841,200 to2,330,056,432 B (46.0365%), but wall rises from1.891826 to4.241058s.
The192MiB cache is charged to both conditions, not a VRAM saving. Forward-call
totals also rise1.593093 to1.944361s: receipt serialization is not the sole loss.
Preserve the negative and stop this LRU candidate before a long matrix.

Frozen protocol,
results and limitations,
course and inspirations,
compact receipts,
source freeze.

Three fresh short prefixes, FP32 OPT1.3B, separate declared warmups, imposed
4800MiB candidate budget and6500MiB reference allowance. Full reference GPU startup
means NO CPU-first capacity claim. Not stronger precision, larger-model deployment,
task-quality qualification or native-pivot evidence. v0.31/v0.34 used Qwen, not
ReLU; their negatives do not close ReLU predictive approaches.

639 CPU tests pass and a second raw audit matches exactly. Pre-inference review
caught an exact-boundary comparison bug; integer byte comparisons and a regression
test fixed it before measurement, without relaxing gates. Raw archive
retention-v037-raw.zip:70,387,510 B,151 members, SHA256
4c7b55de52096c9a27bfbc39bd7cde3f5180c96c2be3e924f078316ee95d9bdd.
Every member is restored/hash checked; checkpoint weights are not redistributed.
Final clean-tip full-suite validation is attached separately.

Complete #52, not
milestone10.
Next: separately freeze causal early acquisition with exact demand completion,
then stronger precision and scale comparisons. No stock tuning or native patch.