-
Notifications
You must be signed in to change notification settings - Fork 488
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add more examples[support dynamic, static and aware_training quantization] #30
Conversation
Is there a test for examples to trigger? |
According to our local test, we should upgrade the minimum version of transformers to 4.10.0 to avoid some errors in fx mode. |
UT failed because PyTorch1.10 is released now. Transformers requires PyTorch 1.9. |
Thanks for the new examples @xin3he, I am currently looking at adding other examples on my side as well (question-answering, token-classification). For the README.md, we are going to follow something close to what was done in transformers such as done for question-answering or summarization. Finally concerning tests for examples, it was not planned initially but we can definitely add it, would you like to discuss it in our next meeting ? If you prefer to have an example before that I can of course create one. |
Hi, @echarlaix, an example of tests will be better for our discussion, thank you. We can discuss it in our next meeting. |
fd9601e
to
9f425a8
Compare
MLM/PLM verifiy_loading failed due to different accuracy between quantization and reloading, which is caused by plm/mlm_probablity leading to different input in reloading. |
bfe1763
to
ac1b328
Compare
ac1b328
to
25f2ef7
Compare
db0b35f
to
2b6bbbc
Compare
8c0041c
to
2b6bbbc
Compare
2b6bbbc
to
6388915
Compare
328bc39
to
79c0c5e
Compare
What does this PR do?
This PR will provide more available tasks for user to apply. Tasks can be apply with dynamic, static or aware_training quantization with INC.
Task includes:
take_eval_step
to ensure verify loading success.issues#14268, PR#14276 fixed the issue.