Skip to content

v1.0.0: the tutorial, complete

Choose a tag to compare

@changkun changkun released this 14 Oct 17:46
· 31 commits to main since this release

The tutorial is complete: ten stages from raw text to a served model, and sixteen side topics that hang off the stage they change. Every number and sample in the notes and films comes from a run saved in runs/, and every note's "Run it" works from a fresh clone, in chain order.

What changed since 0.5.11. The README names the laptop every number was measured on, a MacBook Pro with an M5 Pro and 64 GB of memory. It also says what to expect on another machine: other times, and other last digits, since the same sums are added in another order. Even on this laptop, a greedy reply in 16-bit floats depends on the batch it was generated in. Stage 7 measured the published 0.5B model at 48.6% and 46.6% on the same 500 GSM8K problems.

The films of every chapter are attached, 25 of them.