Skip to content

Conversation

@Gasoonjia
Copy link
Contributor

Summary: this diff introuce the cuda backend that compiles the partitioned model graph to run on CUDA devices. It uses the AOTInductor compiler to generate optimized CUDA kernels for the model's operators with libtorch-free. The compiled model can be executed on CUDA devices using the Executorch runtime.

Reviewed By: angelayi, larryliu0820

Differential Revision: D82987410

@pytorch-bot
Copy link

pytorch-bot bot commented Sep 25, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14574

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 2 Unrelated Failures

As of commit 9e2442c with merge base ebabf52 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following job failed but was likely due to flakiness present on trunk:

BROKEN TRUNK - The following job failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 25, 2025
@facebook-github-bot
Copy link
Contributor

@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D82987410.

Copy link
Contributor

@larryliu0820 larryliu0820 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review automatically exported from Phabricator review in Meta.

@github-actions
Copy link

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Gasoonjia added a commit to Gasoonjia/executorch-1 that referenced this pull request Sep 25, 2025
Summary:


this diff introuce the cuda backend that compiles the partitioned model graph to run on CUDA devices. It uses the AOTInductor compiler to generate optimized CUDA kernels for the model's operators with libtorch-free. The compiled model can be executed on CUDA devices using the Executorch runtime.

Reviewed By: angelayi, larryliu0820

Differential Revision: D82987410
Gasoonjia added a commit to Gasoonjia/executorch-1 that referenced this pull request Sep 25, 2025
Summary:


this diff introuce the cuda backend that compiles the partitioned model graph to run on CUDA devices. It uses the AOTInductor compiler to generate optimized CUDA kernels for the model's operators with libtorch-free. The compiled model can be executed on CUDA devices using the Executorch runtime.

Reviewed By: angelayi, larryliu0820

Differential Revision: D82987410
Gasoonjia added a commit to Gasoonjia/executorch-1 that referenced this pull request Sep 25, 2025
Summary:


this diff introuce the cuda backend that compiles the partitioned model graph to run on CUDA devices. It uses the AOTInductor compiler to generate optimized CUDA kernels for the model's operators with libtorch-free. The compiled model can be executed on CUDA devices using the Executorch runtime.

Reviewed By: angelayi, larryliu0820

Differential Revision: D82987410
@facebook-github-bot
Copy link
Contributor

@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D82987410.

Summary:


this diff introuce the cuda backend that compiles the partitioned model graph to run on CUDA devices. It uses the AOTInductor compiler to generate optimized CUDA kernels for the model's operators with libtorch-free. The compiled model can be executed on CUDA devices using the Executorch runtime.

Reviewed By: angelayi, larryliu0820

Differential Revision: D82987410
@facebook-github-bot
Copy link
Contributor

@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D82987410.

Gasoonjia added a commit to Gasoonjia/executorch-1 that referenced this pull request Sep 25, 2025
Summary:


this diff introuce the cuda backend that compiles the partitioned model graph to run on CUDA devices. It uses the AOTInductor compiler to generate optimized CUDA kernels for the model's operators with libtorch-free. The compiled model can be executed on CUDA devices using the Executorch runtime.

Reviewed By: angelayi, larryliu0820

Differential Revision: D82987410
Gasoonjia added a commit to Gasoonjia/executorch-1 that referenced this pull request Sep 25, 2025
Summary:


this diff introuce the cuda backend that compiles the partitioned model graph to run on CUDA devices. It uses the AOTInductor compiler to generate optimized CUDA kernels for the model's operators with libtorch-free. The compiled model can be executed on CUDA devices using the Executorch runtime.

Reviewed By: angelayi, larryliu0820

Differential Revision: D82987410
Gasoonjia added a commit to Gasoonjia/executorch-1 that referenced this pull request Sep 25, 2025
Summary:


this diff introuce the cuda backend that compiles the partitioned model graph to run on CUDA devices. It uses the AOTInductor compiler to generate optimized CUDA kernels for the model's operators with libtorch-free. The compiled model can be executed on CUDA devices using the Executorch runtime.

Reviewed By: angelayi, larryliu0820

Differential Revision: D82987410
Gasoonjia added a commit to Gasoonjia/executorch-1 that referenced this pull request Sep 25, 2025
Summary:


this diff introuce the cuda backend that compiles the partitioned model graph to run on CUDA devices. It uses the AOTInductor compiler to generate optimized CUDA kernels for the model's operators with libtorch-free. The compiled model can be executed on CUDA devices using the Executorch runtime.

Reviewed By: angelayi, larryliu0820

Differential Revision: D82987410
@facebook-github-bot facebook-github-bot merged commit 87e9c16 into pytorch:main Sep 25, 2025
123 of 132 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants