Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add meta for _embedding_bag_dense_backward and _embedding_bag_per_sample_weights_backward #125785

Closed
wants to merge 2 commits into from

Conversation

ezyang
Copy link
Contributor

@ezyang ezyang commented May 8, 2024

[ghstack-poisoned]
Copy link

pytorch-bot bot commented May 8, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/125785

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit fb4b515 with merge base 96a5698 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

ezyang added a commit that referenced this pull request May 8, 2024
…ple_weights_backward

Signed-off-by: Edward Z. Yang <ezyang@meta.com>

ghstack-source-id: 60294d5a62693058e34a241ec0ada9162d5ff37c
Pull Request resolved: #125785
Copy link
Collaborator

@albanD albanD left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds fair if CI is fixed

# Can't easily test sum, because there is a fast path for sum which
# causes offset2bag to not get allocated... but the backward function
# needs it, and the offset2bag computation lives inside the
# derivatives.yaml formula directly, so there is no way to access it.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure what you mean that the computation lives in the formula?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you can have derivatives.yaml derivative do some compute, e.g., by directly calling a C++ function, before it eventually goes to an actual dispatched op

[ghstack-poisoned]
@ezyang ezyang requested a review from Chillee as a code owner May 9, 2024 00:04
@ezyang ezyang added ciflow/trunk Trigger trunk jobs on your pull request release notes: composability release notes category topic: new features topic category labels May 9, 2024
ezyang added a commit that referenced this pull request May 9, 2024
…ple_weights_backward

Signed-off-by: Edward Z. Yang <ezyang@meta.com>

ghstack-source-id: fba5572a2144d3d9e6089197d08a22d3a5cc368a
Pull Request resolved: #125785
@ezyang
Copy link
Contributor Author

ezyang commented May 9, 2024

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci-td-distributed ciflow/trunk Trigger trunk jobs on your pull request Merged release notes: composability release notes category topic: new features topic category
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants