100k stars!

[rasbt]

Just saw that the LLMs-from-scratch repository passed 100,000 stars on GitHub. This is super cool and motivating. I am really happy to see that this open-source repo has helped so many people. Thanks also to everyone who shared ideas and opened PRs with improvements!

Of course, I plan to keep adding new material, including new attention variants and architectures (while bigger projects like RL and Reasoning From Scratch live in their separate repositories).

I am also currently working on a larger applied custom “small” LLM project. It has been keeping me super busy this month, but I will share more on that soon.

And if you don’t have any weekend plans yet, happy tinkering!