Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CPU SDP] Remove mem efficient attn checks in CPU #112375

Closed
wants to merge 1 commit into from
Closed

[CPU SDP] Remove mem efficient attn checks in CPU #112375

wants to merge 1 commit into from

Commits on Oct 30, 2023

  1. [CPU SDP] Remove mem efficient attn checks in CPU 

    It doesn't seem like memory efficient attention can be used on CPU, as we don't check for it when iterating backends in `select_sdp_backend_cpp`. So removing some of the logic around mem efficient attention.

Created from CodeHub with https://fburl.com/edit-in-codehub

Differential Revision: [D50775562](https://our.internmc.facebook.com/intern/diff/D50775562/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D50775562/)!

[ghstack-poisoned]
    @rohan-varma
    rohan-varma committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    2e774d4 View commit details
    Browse the repository at this point in the history