Skip to content

[executorch] Add coreml quant recipes #13441

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Aug 14, 2025
Merged

Conversation

pytorchbot
Copy link
Collaborator

This PR was created by the merge bot to help merge the original PR into the main branch.
ghstack PR number: #13387 by @abhinaykukkadapu
^ Please use this as the source of truth for the PR details, comments, and reviews
ghstack PR base: https://github.com/pytorch/executorch/tree/gh/abhinaykukkadapu/7/base
ghstack PR head: https://github.com/pytorch/executorch/tree/gh/abhinaykukkadapu/7/head
Merge bot PR base: https://github.com/pytorch/executorch/tree/gh/abhinaykukkadapu/6/orig
Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/abhinaykukkadapu/7/orig
@diff-train-skip-merge

Pull Request resolved: #13386

Fixing tests for stack that got reverted: #13264

Changes:

Support filter function in quantize_ function when using torchao quantize.
Update unittests accordingly
Use ComposableQuantizer if there are multiple quantizers and is of type torchao, for legacy quantizers use them directly with prepare_pt2e.
Source transform modifies model inplace, so deep copy first to avoid modifying user provided model.
ghstack-source-id: 303126052
@exported-using-ghexport

Differential Revision: [D80206543](https://our.internmc.facebook.com/intern/diff/D80206543/)
Pull Request resolved: #13387

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
TORCHAO_INT4_WEIGHT_ONLY_PER_CHANNEL
TORCHAO_INT4_WEIGHT_ONLY_PER_GROUP
TORCHAO_INT8_WEIGHT_ONLY_PER_CHANNEL
TORCHAO_INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY
ghstack-source-id: 303126085
@exported-using-ghexport

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)
Copy link

pytorch-bot bot commented Aug 14, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13441

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 76 Pending, 4 Unrelated Failures

As of commit ed02934 with merge base 46dd51a (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 14, 2025
Base automatically changed from gh/abhinaykukkadapu/6/orig to main August 14, 2025 22:52
@abhinaykukkadapu abhinaykukkadapu merged commit 0ad3df9 into main Aug 14, 2025
102 of 109 checks passed
@abhinaykukkadapu abhinaykukkadapu deleted the gh/abhinaykukkadapu/7/orig branch August 14, 2025 22:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants