-
Notifications
You must be signed in to change notification settings - Fork 0
Wonderful Matrices to Build Small Language Models
License
LoserCheems/WonderfulMatrices
ErrorLooks like something went wrong!
About
Wonderful Matrices to Build Small Language Models
Topics
python
nlp
machine-learning
natural-language-processing
deep-learning
pytorch
transformer
feedforward-neural-network
language-model
attention-mechanism
attention-is-all-you-need
mixture-of-experts
pytorch-transformers
foundation-models
small-language-models
small-language-model
dynamic-mask-attention
cross-domain-mixture-of-experts