Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Is it available fine tuning quantized model using peft library? #233

Closed
daehuikim opened this issue Dec 1, 2023 · 1 comment
Closed

Is it available fine tuning quantized model using peft library? #233

daehuikim opened this issue Dec 1, 2023 · 1 comment

Comments

@daehuikim
Copy link

I am curious any AWQ quantized model could be fine tuned like GPTQ model in the link below.
Any recommendation or possible example codes available by now? or PEFT for AWQ models is not possible?
Thank you!

GPTQ fine tuning: https://colab.research.google.com/drive/1_TIrmuKOFhuRRiTWN94iLKUFu6ZX4ceb?usp=sharing#scrollTo=vT0XjNc2jYKy
@casper-hansen
Copy link
Owner

Duplicate of #85. TLDR; Not possible yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@casper-hansen @daehuikim