[5/N] [Dispatchable Collectives] Update send with CPU / CUDA implementations

[H-Huang]

Stack from ghstack:

• [9/N] [Dispatchable Collectives] Update reduce_scatter with CPU / CUDA implementations #86166 [9/N] [Dispatchable Collectives] Update reduce_scatter with CPU / CUDA implementations
• [8/N] [Dispatchable Collectives] Update allgather with CPU / CUDA implementations  #84423 [8/N] [Dispatchable Collectives] Update allgather with CPU / CUDA implementations
• [7/N] [Dispatchable Collectives] Update reduce with CPU / CUDA implementations #83916 [7/N] [Dispatchable Collectives] Update reduce with CPU / CUDA implementations
• [6/N] [Dispatchable Collectives] Update recv with CPU / CUDA implementations #83876 [6/N] [Dispatchable Collectives] Update recv with CPU / CUDA implementations
• [5/N] [Dispatchable Collectives] Update send with CPU / CUDA implementations #83859 [5/N] [Dispatchable Collectives] Update send with CPU / CUDA implementations

Changes

• Updates for the send collective

Context

#86225

Differential Revision: D40044550

[facebook-github-bot]

🔗 Helpful links

• 🧪  See artifacts and rendered test results at hud.pytorch.org/pr/83859
• ✖️ Python docs build was skipped
• ✖️ C++ docs build was skipped
• ❓Need help or want to give feedback on the CI? Visit our office hours

✅ No Failures (0 Pending)

As of commit cdd1470 (more details on the Dr. CI page):

Expand to see more

---

💚 💚 Looks good so far! There are no failures yet. 💚 💚

---

This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/83859

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 Failures, 12 Pending

As of commit 82deaae:

The following jobs have failed:

• linux-bionic-py3_7-clang8-xla / test (xla, 1, 1, linux.2xlarge)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[kwen2501]

LGTM! Thanks!

nit: missing _ at the end of function name ("send_cpu", "send_cuda").

[H-Huang]

nit: missing _ at the end of function name ("send_cpu", "send_cuda").

The convention is that _ after operation means that the tensor is modified in-place. For barrier and send we do not modify the tensor, therefore those ops dont have "_" after

[kwen2501]

I see, thanks for the education!

[H-Huang]

@H-Huang has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

/easycla

As part of the transition to the PyTorch Foundation, this project now requires contributions be covered under the new CLA. See #85559 for additional details.

This comment will trigger a new check of this PR. If you are already covered, you will simply see a new "EasyCLA" check that passes. If you are not covered, a bot will leave a new comment with a link to sign.

[H-Huang]

@pytorchbot merge -f "xla failure is unrelated and due to #86093"

[pytorchmergebot]

@pytorchbot successfully started a merge job. Check the current status here.
The merge job was triggered with the force (-f) flag. This means your change will be merged immediately, bypassing any CI checks (ETA: 1-5 minutes). If this is not the intended behavior, feel free to use some of the other merge options in the wiki.
Please reach out to the PyTorch DevX Team with feedback or questions!