Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added add/mul for nested dense [B, *, D], [B, 1, D] case (CUDA-only) #88289

Conversation

mikaylagawarecki
Copy link
Contributor

@mikaylagawarecki mikaylagawarecki commented Nov 2, 2022

@pytorch-bot
Copy link

pytorch-bot bot commented Nov 2, 2022

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/88289

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 Failures

As of commit ddd6f12:

The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

mikaylagawarecki added a commit that referenced this pull request Nov 2, 2022
ghstack-source-id: 7ca8b3c3c0218e3f7c0ca3903e6510cacb8e0f9c
Pull Request resolved: #88289
@mikaylagawarecki mikaylagawarecki added release notes: nested tensor Changes that have a direct impact on nested tensors topic: improvements topic category labels Nov 2, 2022
mikaylagawarecki added a commit that referenced this pull request Nov 2, 2022
ghstack-source-id: fa0d9593327442bcbc983096916bc41a46ec9019
Pull Request resolved: #88289
@mikaylagawarecki mikaylagawarecki changed the title Added add for nested dense [B, *, D], [B, 1, D] case (CUDA-only) Added add/mul for nested dense [B, *, D], [B, 1, D] case (CUDA-only) Nov 2, 2022
@mikaylagawarecki mikaylagawarecki added the ciflow/trunk Trigger trunk jobs on your pull request label Nov 2, 2022
mikaylagawarecki added a commit that referenced this pull request Nov 2, 2022
ghstack-source-id: 0acc750a59bac110b2d8086d9b428b3812e75115
Pull Request resolved: #88289
@cpuhrsch
Copy link
Contributor

cpuhrsch commented Nov 2, 2022

Current test failures seem unrelated

Copy link
Contributor

@cpuhrsch cpuhrsch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks good (see last nit). Also we'll need to mark this CUDA kernel for iterative improvements once we have end to end benchmarks.

mikaylagawarecki added a commit that referenced this pull request Nov 2, 2022
ghstack-source-id: e40878da8d04c71b787a5e19b83e3311a681dd9c
Pull Request resolved: #88289
@mikaylagawarecki
Copy link
Contributor Author

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@pytorchmergebot
Copy link
Collaborator

Merge failed

Reason: The following mandatory check(s) failed (Rule superuser):

Dig deeper by viewing the failures on hud

Details for Dev Infra team Raised by workflow job

@mikaylagawarecki
Copy link
Contributor Author

@pytorchbot rebase -s

@pytorchmergebot
Copy link
Collaborator

@pytorchbot successfully started a rebase job. Check the current status here

@pytorchmergebot
Copy link
Collaborator

Tried to rebase and push PR #88289, but it was already up to date

@mikaylagawarecki
Copy link
Contributor Author

@pytorchbot merge -f "failure is unrelated"

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

kulinseth pushed a commit to kulinseth/pytorch that referenced this pull request Nov 5, 2022
kulinseth pushed a commit to kulinseth/pytorch that referenced this pull request Dec 10, 2022
jbschlosser added a commit that referenced this pull request Feb 27, 2023
…nse (CUDA only)"


Small hack to reuse the ESUHM kernel from #88289 for [B, *] nested, [B, 1] dense elementwise add / mul. Simply treat the inputs as [B, *, 1], [B, 1, 1]. This is added to satisfy an ask from the Ads team.

Future work: full general broadcasting support between mixed nested / dense.

cc cpuhrsch bhosmer drisspg mikaylagawarecki

[ghstack-poisoned]
pytorchmergebot pushed a commit that referenced this pull request Feb 27, 2023
…nly) (#95620)

Small hack to reuse the 3D custom kernel from #88289 for [B, *] nested, [B, 1] dense elementwise add / mul. Simply treat the inputs as [B, *, 1], [B, 1, 1]. This is added to satisfy an internal ask.

Future work: full general broadcasting support between mixed nested / dense.

Pull Request resolved: #95620
Approved by: https://github.com/cpuhrsch, https://github.com/drisspg
@facebook-github-bot facebook-github-bot deleted the gh/mikaylagawarecki/93/head branch June 8, 2023 17:59
jhavukainen pushed a commit to kulinseth/pytorch that referenced this pull request Mar 15, 2024
…nly) (pytorch#95620)

Small hack to reuse the 3D custom kernel from pytorch#88289 for [B, *] nested, [B, 1] dense elementwise add / mul. Simply treat the inputs as [B, *, 1], [B, 1, 1]. This is added to satisfy an internal ask.

Future work: full general broadcasting support between mixed nested / dense.

Pull Request resolved: pytorch#95620
Approved by: https://github.com/cpuhrsch, https://github.com/drisspg
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ciflow/trunk Trigger trunk jobs on your pull request Merged release notes: nested tensor Changes that have a direct impact on nested tensors topic: improvements topic category
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants