GitHub - Rithan377/RLM: RLM — Rithan Language Model is a 150 million parameter transformer-based language model built from scratch, designed for general conversation and basic arithmetic inspired form Mr Anderj Karpathy MIcrogpt .architecture draws from modern language model research, incorporating Rotary Positional Embeddings (RoPE) and GPT 2 ecoding for consumer HRD

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
RLM		RLM
__pycache__		__pycache__
my_microgpt		my_microgpt
.gitignore		.gitignore
dataa.txt		dataa.txt
dataconvert.py		dataconvert.py
files.zip		files.zip
infer.zip		infer.zip
inference.py		inference.py
microgpt.py		microgpt.py
microgpt_bpe_best.pt		microgpt_bpe_best.pt
microgpt_bpe_model.pt		microgpt_bpe_model.pt
microgpt_dataset.zip		microgpt_dataset.zip
microgpt_vocab.json		microgpt_vocab.json
microgptpt.py		microgptpt.py
microgptpytorch.py		microgptpytorch.py
microgpttensor.py		microgpttensor.py
synthetic_data.py		synthetic_data.py
train.py		train.py

About

RLM — Rithan Language Model is a 150 million parameter transformer-based language model built from scratch, designed for general conversation and basic arithmetic inspired form Mr Anderj Karpathy MIcrogpt .architecture draws from modern language model research, incorporating Rotary Positional Embeddings (RoPE) and GPT 2 ecoding for consumer HRD