New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

attention_mask should not be sent repeatedly #177

Closed

zhisbug opened this issue Nov 10, 2021 · 1 comment

Assignees

Member

zhisbug commented Nov 10, 2021

It seems that it should be an RDA.

If we send it every iter, it will block the default stream

zhisbug changed the title ~~attention_make should not be sent repeatedly~~ attention_mask should not be sent repeatedly

ZYHowell self-assigned this

ZYHowell added the p1 label

Collaborator

ZYHowell commented Feb 4, 2022

ZYHowell closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment