Building-Large-Language-Model

From tokenizer to transformer: building an LLM from scratch, step by step, with clear code

Name		Name	Last commit message	Last commit date
Latest commit History 10 Commits
BPE_and_Data_Sampling_with_sliding_window.ipynb		BPE_and_Data_Sampling_with_sliding_window.ipynb
Building_Tokenizer.ipynb		Building_Tokenizer.ipynb
Causal_Attention.ipynb		Causal_Attention.ipynb
Multi_Head_Attention_With_Weight_Split.ipynb		Multi_Head_Attention_With_Weight_Split.ipynb
README.md		README.md
Self_Attention_with_Trainable_Weights.ipynb		Self_Attention_with_Trainable_Weights.ipynb
Self_Attention_without_Trainable_Weights.ipynb		Self_Attention_without_Trainable_Weights.ipynb
Simple_Multi_Head_Attention.ipynb		Simple_Multi_Head_Attention.ipynb
The_Verdict.txt		The_Verdict.txt
Token_and_Positional_Embedding.ipynb		Token_and_Positional_Embedding.ipynb

Provide feedback