Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable cadd_sparse for BFloat16 on CPU #96767

Closed

Conversation

itaraban
Copy link
Contributor

Enabling cadd_sparse operation for BFloat16 on CPU to support BFloat16 operations in GNN libraries.

@pytorch-bot
Copy link

pytorch-bot bot commented Mar 14, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/96767

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit f824aad:
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added the release notes: sparse release notes category label Mar 14, 2023
@linux-foundation-easycla
Copy link

linux-foundation-easycla bot commented Mar 14, 2023

CLA Signed

The committers listed above are authorized under a signed CLA.

  • ✅ login: itaraban / name: Ilia Taraban (9f93a0b)

@itaraban
Copy link
Contributor Author

@nikitaved, Could you please review my changes?

@jgong5 jgong5 requested a review from cpuhrsch March 30, 2023 13:52
y = y.float().cuda()
x = x.float()
y = y.float()
if device == 'cuda':
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This shouldn't be necessary since device is passed to _gen_sparse above.

In general it's strange that we annotate this with @dtypes(torch.double, torch.cdouble) and then convert to float right away.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, I'll remove this part and change dtypes to torch.float

Copy link
Contributor

@cpuhrsch cpuhrsch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See inline comments around test. Otherwise code change looks like.

@itaraban itaraban force-pushed the enable_cadd_sparse_bfloat16 branch from 9f93a0b to 22ba0c9 Compare March 30, 2023 22:54
@itaraban itaraban requested a review from cpuhrsch March 30, 2023 22:55
@bdhirsh bdhirsh added the triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module label Mar 31, 2023
@jgong5
Copy link
Collaborator

jgong5 commented Apr 7, 2023

@cpuhrsch @itaraban has updated the code. Is it good to land?

@cpuhrsch
Copy link
Contributor

@pytorchbot merge

@pytorch-bot pytorch-bot bot added the ciflow/trunk Trigger trunk jobs on your pull request label Apr 13, 2023
@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@pytorchmergebot
Copy link
Collaborator

Merge failed

Reason: This PR is too stale; the last push date was more than 3 days ago. Please rebase and try again. You can rebase and merge by leaving the following comment on this PR:
@pytorchbot merge -r
Or just rebase by leaving @pytorchbot rebase comment

Details for Dev Infra team Raised by workflow job

@itaraban itaraban force-pushed the enable_cadd_sparse_bfloat16 branch from 22ba0c9 to f824aad Compare April 13, 2023 22:26
@cpuhrsch
Copy link
Contributor

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

ZainRizvi pushed a commit that referenced this pull request Apr 19, 2023
Enabling **cadd_sparse** operation for BFloat16 on CPU to support BFloat16 operations in GNN libraries.

Pull Request resolved: #96767
Approved by: https://github.com/jgong5, https://github.com/cpuhrsch
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ciflow/trunk Trigger trunk jobs on your pull request Merged open source release notes: sparse release notes category triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants