Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix GroupNorm backward prop on CUDA #92671

Closed
wants to merge 2 commits into from

Conversation

malfet
Copy link
Contributor

@malfet malfet commented Jan 20, 2023

Fixes regression introduced by #89485

Adds test to prevent those regressions from happening in the future In process, discovered that GroupNormBackwards on CPU does not produce the same results if input and gradient memory_format is different

Fixes #92166

Fixes regression introduced by #89485

Adds test to prevent those regressions from happening in the future
In process, discovered that GroupNormBackwards on CPU does not produce
the same results if input and gradient memory_format is different
@pytorch-bot pytorch-bot bot added the release notes: nn release notes category label Jan 20, 2023
@pytorch-bot
Copy link

pytorch-bot bot commented Jan 20, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/92671

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 2436560:
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Copy link
Contributor

@xuzhao9 xuzhao9 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing this!

@malfet
Copy link
Contributor Author

malfet commented Jan 20, 2023

@pytorchbot merge

@pytorch-bot pytorch-bot bot added the ciflow/trunk Trigger trunk jobs on your pull request label Jan 20, 2023
@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@malfet malfet deleted the malfet/fix-group-norm-channels-last branch January 20, 2023 22:23
pytorchmergebot pushed a commit that referenced this pull request Feb 9, 2023
…rd (#92668)

Fixes the skipped part of the test on #92671. Align the input memory format and the grad memory format for GroupNorm backward.

Pull Request resolved: #92668
Approved by: https://github.com/jgong5, https://github.com/malfet
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ciflow/trunk Trigger trunk jobs on your pull request Merged release notes: nn release notes category
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Recent PyTorch nightly builds breaks DALLE2_pytorch model in Torchbench
4 participants