Fai-yong / pytorch_deeplearning Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

pytorch implementation of modules like MHA, GQA, MQA, FFN, RoPE...

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
answer		answer
embedding		embedding
norm		norm
sort		sort
GQA.py		GQA.py
MHA.py		MHA.py
MLA.py		MLA.py
MQA.py		MQA.py
README.md		README.md
attention.py		attention.py
sdpa.py		sdpa.py

Repository files navigation

pytorch_deeplearning

pytorch implementation of modules like MHA, GQA, MQA, FFN, RoPE...

About

pytorch implementation of modules like MHA, GQA, MQA, FFN, RoPE...

Report repository

Releases

No releases published

Packages

No packages published

Contributors 2

Languages

Python 100.0%