-
Notifications
You must be signed in to change notification settings - Fork 21.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Added add/mul for nested dense [B, *, D], [B, 1, D] case (CUDA-only) #88289
Added add/mul for nested dense [B, *, D], [B, 1, D] case (CUDA-only) #88289
Conversation
[ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/88289
Note: Links to docs will display an error until the docs builds have been completed. ❌ 1 FailuresAs of commit ddd6f12: The following jobs have failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
ghstack-source-id: 7ca8b3c3c0218e3f7c0ca3903e6510cacb8e0f9c Pull Request resolved: #88289
…-only)" [ghstack-poisoned]
ghstack-source-id: fa0d9593327442bcbc983096916bc41a46ec9019 Pull Request resolved: #88289
…CUDA-only)" [ghstack-poisoned]
ghstack-source-id: 0acc750a59bac110b2d8086d9b428b3812e75115 Pull Request resolved: #88289
Current test failures seem unrelated |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Generally looks good (see last nit). Also we'll need to mark this CUDA kernel for iterative improvements once we have end to end benchmarks.
…CUDA-only)" [ghstack-poisoned]
ghstack-source-id: e40878da8d04c71b787a5e19b83e3311a681dd9c Pull Request resolved: #88289
@pytorchbot merge |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Merge failedReason: The following mandatory check(s) failed (Rule Dig deeper by viewing the failures on hud Details for Dev Infra teamRaised by workflow job |
@pytorchbot rebase -s |
@pytorchbot successfully started a rebase job. Check the current status here |
Tried to rebase and push PR #88289, but it was already up to date |
@pytorchbot merge -f "failure is unrelated" |
Merge startedYour change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
…ytorch#88289) Pull Request resolved: pytorch#88289 Approved by: https://github.com/cpuhrsch
…ytorch#88289) Pull Request resolved: pytorch#88289 Approved by: https://github.com/cpuhrsch
…nse (CUDA only)" Small hack to reuse the ESUHM kernel from #88289 for [B, *] nested, [B, 1] dense elementwise add / mul. Simply treat the inputs as [B, *, 1], [B, 1, 1]. This is added to satisfy an ask from the Ads team. Future work: full general broadcasting support between mixed nested / dense. cc cpuhrsch bhosmer drisspg mikaylagawarecki [ghstack-poisoned]
…nly) (#95620) Small hack to reuse the 3D custom kernel from #88289 for [B, *] nested, [B, 1] dense elementwise add / mul. Simply treat the inputs as [B, *, 1], [B, 1, 1]. This is added to satisfy an internal ask. Future work: full general broadcasting support between mixed nested / dense. Pull Request resolved: #95620 Approved by: https://github.com/cpuhrsch, https://github.com/drisspg
…nly) (pytorch#95620) Small hack to reuse the 3D custom kernel from pytorch#88289 for [B, *] nested, [B, 1] dense elementwise add / mul. Simply treat the inputs as [B, *, 1], [B, 1, 1]. This is added to satisfy an internal ask. Future work: full general broadcasting support between mixed nested / dense. Pull Request resolved: pytorch#95620 Approved by: https://github.com/cpuhrsch, https://github.com/drisspg
Stack from ghstack (oldest at bottom):