Skip to content

pytorch实现的基于attention is all your need提出的Q,K,V的attention模板和派生的attention实现。

Notifications You must be signed in to change notification settings

sakuranew/attention-pytorch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

attention

implement some attention by pytorch base on Q,K,V from the paper "attention is all your need"

学习的过程中没有找到一个比较模板化的attention实现加上一些派生的attention用法, 于是实现了基于 "attention is all your need" 谷歌这篇论文提出的Q,K,V的attention模板,并且打算后续加上一些学习到的attention用法

About

pytorch实现的基于attention is all your need提出的Q,K,V的attention模板和派生的attention实现。

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages