Repository navigation
The key-value account was exploratory in v0.1. This release puts it on the line: a second pre-registration, pushed before the analyses ran, and all 11 of its tests hold.
Pre-registration 2 (PREREGISTRATION_2.md, tag prereg2-94b6cf8)
| Test | Result | Verdict |
|---|---|---|
| H6a: swapping only the late blocks' context keys and values transfers >= 0.8 of the behaviour (long60k, deep8, wide256) | 0.85-0.96 | supported in all 3 |
| H6b: block 1 alone transfers <= 0.3 | 0.01-0.13 | supported in all 3 |
| H6c: at matched dimension the key-value memory reads the Bayes estimate >= 0.15 R^2 better than the residual stream | 0.85-0.92 vs 0.52-0.71 | supported in all 3 |
| H7a: under a shifted prior (A entries 4x smaller), the query Jacobian is closer to ridge with the training prior than to the new prior's Bayes estimate | 0.026 vs 0.028, 10/10 seeds | supported |
| H7b: ... and closer than to OLS | 0.026 vs 0.036, 10/10 seeds | supported |
Holm-corrected over the 11 tests. The 0.1M-parameter model, reported without hypotheses, is where the readability gap reverses. The H7a margin is small: once t >= 8 the two ridge estimates differ little, and the paper says so. Full table: results/confirm/SUMMARY.md. The first run on the GPU ran out of memory; its partial outputs were deleted unread and everything was re-run on the CPU (DEVIATIONS item 19).
Paper (main.pdf)
- Section 8 and Appendix E report the confirmation; the abstract, introduction and limitations say what is now confirmed and what is still open (other tasks). Main text still 10 pages.
- Fixed: number ranges inside formulas printed as two minus signs ("0.91 - - 0.94") in 20 places, including the abstract. No number changed.
Also
- All 51 checkpoints on the Hugging Face Hub: https://huggingface.co/nonberew/suss-models
- Since v0.1.3: the live demo (https://nonberw.github.io/suss/demo/), issue templates, changelog, lockfile and lint in CI.
Assets: main.pdf (paper), arxiv_source.zip (LaTeX source for arXiv), supplement.zip.