aoti_torch_create_tensor_from_blob_v2 #14604
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Gasoonjia
requested review from
larryliu0820 and
kirklandsign
as code owners
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14604
Note: Links to docs will display an error until the docs builds have been completed. ❌ 2 New Failures, 2 Cancelled Jobs, 1 Unrelated FailureAs of commit ca821bc with merge base df8d03b ( NEW FAILURES - The following jobs have failed:
CANCELLED JOBS - The following jobs were cancelled. Please retry:
FLAKY - The following job failed but was likely due to flakiness present on trunk:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
meta-cla
bot
added
the
CLA Signed
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
This PR needs a
|
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 25, 2025
Summary: Pull Request resolved: pytorch#14604 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Differential Revision: D83094602
Gasoonjia
force-pushed
the
export-D83094602
branch
from
96656e6 to
f4cc1b3
Compare
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
Gasoonjia
force-pushed
the
export-D83094602
branch
from
f4cc1b3 to
caaabe4
Compare
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 25, 2025
Summary: Pull Request resolved: pytorch#14604 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Differential Revision: D83094602
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 25, 2025
Summary: Pull Request resolved: pytorch#14604 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Differential Revision: D83094602
Gasoonjia
force-pushed
the
export-D83094602
branch
from
caaabe4 to
c202db4
Compare
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 25, 2025
Summary: Pull Request resolved: pytorch#14604 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Differential Revision: D83094602
Gasoonjia
force-pushed
the
export-D83094602
branch
from
c202db4 to
ecf9fc5
Compare
larryliu0820
approved these changes
Sep 25, 2025
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 26, 2025
Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: larryliu0820 Differential Revision: D83094602
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 26, 2025
Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: larryliu0820 Differential Revision: D83094602
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 26, 2025
Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: larryliu0820 Differential Revision: D83094602
Gasoonjia
force-pushed
the
export-D83094602
branch
from
ecf9fc5 to
71fd241
Compare
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 26, 2025
Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: larryliu0820 Differential Revision: D83094602
Gasoonjia
force-pushed
the
export-D83094602
branch
from
71fd241 to
3998c54
Compare
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 26, 2025
Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: larryliu0820 Differential Revision: D83094602
Gasoonjia
force-pushed
the
export-D83094602
branch
2 times, most recently
from
41402c2 to
f48be9d
Compare
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 26, 2025
Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: larryliu0820 Differential Revision: D83094602
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
1 similar comment
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
Summary: this diff introduce aoti_tensor_empty_strided to et cuda backend, which will be one of the main functions to create empty tensor using the given stride. Reviewed By: larryliu0820 Differential Revision: D83094606
Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: larryliu0820 Differential Revision: D83094605
Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: larryliu0820 Differential Revision: D83094602
Gasoonjia
force-pushed
the
export-D83094602
branch
from
f48be9d to
5b0a702
Compare
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 28, 2025
Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: larryliu0820 Differential Revision: D83094602
Gasoonjia
force-pushed
the
export-D83094602
branch
from
5b0a702 to
ca821bc
Compare
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
1 similar comment
|
@Gasoonjia has exported this pull request. If you are a Meta employee, you can view the originating diff in D83094602. |
Gasoonjia
added a commit
to Gasoonjia/executorch-1
that referenced
this pull request
Sep 28, 2025
Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: larryliu0820 Differential Revision: D83094602
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary:
This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size.
Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed.
Differential Revision: D83094602