Skip to content

v0.5.8: corrections from a review

Choose a tag to compare

@changkun changkun released this 14 Oct 07:38
· 52 commits to main since this release

Corrections from a review of every note against its saved runs, code and references.

Two change how earlier results should be read:

  • The intervals do not cover the arithmetic. On the laptop's GPU in 16-bit floats, a greedy reply depends on the batch it was generated in: the published 0.5B model solved 48.6% and 46.6% of the same 500 GSM8K problems in two runs. The paired intervals used throughout cover which problems were drawn, not this. Stage 7 now says so, and a difference of a point or two should be read with it in mind.
  • 6a's prompt for the published model spells the tool-call markers out as characters, where Qwen's own tokenizer writes them as single tokens. The published model's 0.5% call rate may partly reflect this; the note now says so.

Also:

  • Numbers corrected against their files: 2b's gain from a passage read before, 3c's misses of the law, 9a's steps per round, 10's file size.
  • Overstated claims qualified: 8a's refusals of safe requests, 7b's judges and long stories, 9a's shrinking gains.
  • Commands in "Run it" now reproduce the saved runs of 4a, 7 and 7b.
  • Citations corrected: DeepSeek-R1-Zero for the replies that grew longer, R1's training stages, STaR's rounds, the GPT-4 version of TinyStories.
  • Outside tools brought up to date: vLLM on macOS, mlx_lm's decode loop, SGLang in TGI's place, FP8 training.
  • Side topics: stages 3, 6, 7 and 8 now name theirs.
  • 9a's film says later rounds add less, as the note does.
  • scripts/dpo.py: the --beta help now says a larger beta holds the policy tighter.

The films of every chapter are attached, 25 of them.