A rigorous, glass-box implementation of a modern Llama-style Transformer (RoPE, RMSNorm, SwiGLU) built from scratch for educational analysis and interpretability.
-
Updated
Dec 12, 2025 - Python
A rigorous, glass-box implementation of a modern Llama-style Transformer (RoPE, RMSNorm, SwiGLU) built from scratch for educational analysis and interpretability.
Add a description, image, and links to the zero-to-hero topic page so that developers can more easily learn about it.
To associate your repository with the zero-to-hero topic, visit your repo's landing page and select "manage topics."