implement some attention by pytorch base on Q,K,V from the paper "attention is all your need"
学习的过程中没有找到一个比较模板化的attention实现加上一些派生的attention用法， 于是实现了基于 "attention is all your need" 谷歌这篇论文提出的Q,K,V的attention模板，并且打算后续加上一些学习到的attention用法
forked from sakuranew/attention-pytorch
-
Notifications
You must be signed in to change notification settings - Fork 0
KaizenGirl1111/attention-pytorch
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
pytorch实现的基于attention is all your need提出的Q,K,V的attention模板和派生的attention实现。
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Python 100.0%