-
Notifications
You must be signed in to change notification settings - Fork 21.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add meta for _embedding_bag_dense_backward and _embedding_bag_per_sample_weights_backward #125785
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/125785
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit fb4b515 with merge base 96a5698 (): This comment was automatically generated by Dr. CI and updates every 15 minutes. |
…ple_weights_backward Signed-off-by: Edward Z. Yang <ezyang@meta.com> ghstack-source-id: 60294d5a62693058e34a241ec0ada9162d5ff37c Pull Request resolved: #125785
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sounds fair if CI is fixed
# Can't easily test sum, because there is a fast path for sum which | ||
# causes offset2bag to not get allocated... but the backward function | ||
# needs it, and the offset2bag computation lives inside the | ||
# derivatives.yaml formula directly, so there is no way to access it. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm not sure what you mean that the computation lives in the formula?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
you can have derivatives.yaml derivative do some compute, e.g., by directly calling a C++ function, before it eventually goes to an actual dispatched op
…ple_weights_backward Signed-off-by: Edward Z. Yang <ezyang@meta.com> ghstack-source-id: fba5572a2144d3d9e6089197d08a22d3a5cc368a Pull Request resolved: #125785
@pytorchbot merge |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Stack from ghstack (oldest at bottom):
Signed-off-by: Edward Z. Yang ezyang@meta.com