Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

[1.6.x] Cherry-pick Interleaved MHA for CPU path (#17138) #17211

Merged
merged 1 commit into from Jan 4, 2020
Merged

[1.6.x] Cherry-pick Interleaved MHA for CPU path (#17138) #17211

merged 1 commit into from Jan 4, 2020

Conversation

eric-haibin-lin
Copy link
Member

backport #17138

@TaoLv
Interleaved MHA for CPU path (apache#17138)
d240f83 
* init qk attention

* qk: fake backward

* cpu selfatt and encdec; move tests to test_operator.py

* coding style

* fix lint

* use random seed in tests

* remove ut in test_operator_gpu.py

* coding style

* retrigger ci
@eric-haibin-lin
Copy link
Member Author

@ptrendx can we merge this to v1.6?

@eric-haibin-lin
Copy link
Member Author

@TaoLv @PatricZhao FYI

@TaoLv TaoLv changed the title Cherry-pick Interleaved MHA for CPU path (#17138) [1.6.x] Cherry-pick Interleaved MHA for CPU path (#17138) Jan 4, 2020
@ptrendx ptrendx merged commit a0fcb9a into apache:v1.6.x Jan 4, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@TaoLv TaoLv TaoLv approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@eric-haibin-lin @TaoLv @ptrendx