Repository navigation
v0.5.8: corrections from a review
Corrections from a review of every note against its saved runs, code and references.
Two change how earlier results should be read:
- The intervals do not cover the arithmetic. On the laptop's GPU in 16-bit floats, a greedy reply depends on the batch it was generated in: the published 0.5B model solved 48.6% and 46.6% of the same 500 GSM8K problems in two runs. The paired intervals used throughout cover which problems were drawn, not this. Stage 7 now says so, and a difference of a point or two should be read with it in mind.
- 6a's prompt for the published model spells the tool-call markers out as characters, where Qwen's own tokenizer writes them as single tokens. The published model's 0.5% call rate may partly reflect this; the note now says so.
Also:
- Numbers corrected against their files: 2b's gain from a passage read before, 3c's misses of the law, 9a's steps per round, 10's file size.
- Overstated claims qualified: 8a's refusals of safe requests, 7b's judges and long stories, 9a's shrinking gains.
- Commands in "Run it" now reproduce the saved runs of 4a, 7 and 7b.
- Citations corrected: DeepSeek-R1-Zero for the replies that grew longer, R1's training stages, STaR's rounds, the GPT-4 version of TinyStories.
- Outside tools brought up to date: vLLM on macOS, mlx_lm's decode loop, SGLang in TGI's place, FP8 training.
- Side topics: stages 3, 6, 7 and 8 now name theirs.
- 9a's film says later rounds add less, as the note does.
scripts/dpo.py: the--betahelp now says a larger beta holds the policy tighter.
The films of every chapter are attached, 25 of them.