Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[OpenFold] Custom parts / AlphaFold #153

Closed
blefaudeux opened this issue Dec 13, 2021 · 1 comment
Closed

[OpenFold] Custom parts / AlphaFold #153

blefaudeux opened this issue Dec 13, 2021 · 1 comment
Labels
blocked

Comments

@blefaudeux
Copy link
Contributor

blefaudeux commented Dec 13, 2021 •
edited

馃殌 Feature

Checkout the discussion here, OpenFold is missing a couple of custom/optimized parts in PyTorch and maybe that xformers could host some of these

Motivation

  • Transformer related
  • Custom parts, not handled out of the box by the PyTorch primitives in a fast enough fashion
  • Possibly good candidates for Triton, Functorch or Sputnik, but would need more reading..

Pitch

Implement some of these primitives in xformers

Alternatives

Well, do nothing

Additional context

AlphaFold2 supplementary data: https://static-content.springer.com/esm/art%3A10.1038%2Fs41586-021-03819-2/MediaObjects/41586_2021_3819_MOESM1_ESM.pdf
@blefaudeux blefaudeux changed the title [OpenFold] [OpenFold] Custom parts / AlphaFold Dec 13, 2021
This was referenced Dec 18, 2021
Closed
Closed
@blefaudeux
Copy link
Contributor Author

blocked by current triton (consecutive matmuls in a given kernel are not well supported), sorry about that @gahdritz, I'll revisit this over time

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
blocked
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@blefaudeux