From Tin to Tokens v1.0

First edition. A free textbook on building an LLM inference stack from scratch in Rust: 192 pages, from the driver interface to a production serving stack, with every measured number stating its hardware and conditions.

Download the PDF below.

Found a correction? Open an erratum with the page number: https://github.com/MaincodeHQ/from-tin-to-tokens/issues/new/choose

Licensed under Creative Commons Attribution 4.0.