Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ONNX] Enable 'ExportOutput.save' for models larger than 2GB #107904

Closed
wants to merge 4 commits into from

Conversation

BowenBao
Copy link
Collaborator

@BowenBao BowenBao commented Aug 24, 2023

Stack from ghstack (oldest at bottom):

Previously it fails during serialization, despite onnxscript graph_building managed to return ModelProto > 2GB.

@pytorch-bot
Copy link

pytorch-bot bot commented Aug 24, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/107904

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (1 Unrelated Failure)

As of commit 0f07ca7 with merge base 1ef4bd1 (image):

UNSTABLE - The following job failed but was likely due to flakiness present on trunk and has been marked as unstable:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added release notes: onnx torch.onnx related changes that should show up in the release notes labels Aug 24, 2023
BowenBao added a commit that referenced this pull request Aug 24, 2023
ghstack-source-id: e92a457a3648d78f268649c6a256f31a70b87fa5
Pull Request resolved: #107904
Previously it fails during serialization, despite onnxscript graph_building managed to return ModelProto > 2GB.


[ghstack-poisoned]
BowenBao added a commit that referenced this pull request Aug 24, 2023
ghstack-source-id: addb87d18df4175ef7c29be205e30f346cee6c8a
Pull Request resolved: #107904
@BowenBao BowenBao marked this pull request as ready for review August 24, 2023 23:17
… 2GB"


Previously it fails during serialization, despite onnxscript graph_building managed to return ModelProto > 2GB.


[ghstack-poisoned]
BowenBao added a commit that referenced this pull request Aug 24, 2023
ghstack-source-id: 9593c65479fd4d7faa66925dd7028b072b38ef81
Pull Request resolved: #107904
Copy link
Contributor

@abock abock left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good for now. We should revisit the serializer protocol again for 2.2.

torch/onnx/_internal/exporter.py Outdated Show resolved Hide resolved
Previously it fails during serialization, despite onnxscript graph_building managed to return ModelProto > 2GB.


[ghstack-poisoned]
BowenBao added a commit that referenced this pull request Aug 25, 2023
ghstack-source-id: b8c31b52901880eb231e124e19794d4f0a430cea
Pull Request resolved: #107904
@BowenBao
Copy link
Collaborator Author

@pytorchbot merge

@pytorch-bot pytorch-bot bot added the ciflow/trunk Trigger trunk jobs on your pull request label Aug 25, 2023
@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

voznesenskym pushed a commit that referenced this pull request Aug 27, 2023
Previously it fails during serialization, despite onnxscript graph_building managed to return ModelProto > 2GB.

Pull Request resolved: #107904
Approved by: https://github.com/abock
@facebook-github-bot facebook-github-bot deleted the gh/BowenBao/292/head branch August 28, 2023 14:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ciflow/trunk Trigger trunk jobs on your pull request Merged open source release notes: onnx torch.onnx related changes that should show up in the release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants