[torchao] Add regex support for ModuleFqnToConfig #41242
+97
−1
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jerryzh168
force-pushed
the
working-base
branch
from
33b49f2 to
225d5f3
Compare
jerryzh168
changed the title
|
cc @MekkCyber for quantization |
jerryzh168
force-pushed
the
working-base
branch
2 times, most recently
from
3fc0850 to
c82e4fa
Compare
Summary: Similar to pytorch/ao#3084 we added regex support in transformers so people can use regex to quantize the models. See pytorch/ao#3084 for docs and precedence of different configurations Uploaded model: https://huggingface.co/torchao-testing/opt-125m-ModuleFqnToConfig-v1-regex-0.14.0.dev Test Plan: pytest tests/quantization/torchao_integration/test_torchao.py -k test_module_fqn_to_config_regex Reviewers: Subscribers: Tasks: Tags:
jerryzh168
force-pushed
the
working-base
branch
from
c82e4fa to
dbc07a0
Compare
|
also cc @SunMarc please take a look |
|
[For maintainers] Suggested jobs to run (before merge) run-slow: torchao_integration |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary:
Similar to pytorch/ao#3084 we added regex support in transformers so people can use regex to quantize the models.
See pytorch/ao#3084 for docs and precedence of different configurations
Uploaded model: https://huggingface.co/torchao-testing/opt-125m-ModuleFqnToConfig-v1-regex-0.14.0.dev
Test Plan:
pytest tests/quantization/torchao_integration/test_torchao.py -k test_module_fqn_to_config_regex
Reviewers:
Subscribers:
Tasks:
Tags: