New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Attention模块代码中的shortcut #35

Open

GoPikachue opened this issue Mar 4, 2024 · 0 comments

GoPikachue commented Mar 4, 2024

作者您好！
我注意到代码中的Attention模块里面存在一个论文中未标注的shortcut被用于残差连接。

想请问一下，这个连接是必要的吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment