Skip to content

NeuralNoble/LLMS_from_scratch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🧠 LLMs From Scratch — My Personal Deep Dive

This repository is my learning lab for building, training, and understanding large language models (LLMs) from the ground up.
Everything here is coded manually — no shortcuts, no black boxes — to deeply understand how transformers, tokenizers, optimizers, and distributed training truly work.


📖 Overview

I’m implementing and experimenting with different LLM architectures, attention mechanisms, and modern model designs that keep appearing in research and open-source projects. The goal is simple — to understand how these models actually work by building them myself, one at a time.


About

learning lab for building, training, and understanding LLMs from scratch

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors