-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Usage] errors when restore checkpoint using lora finetuning #1492
Comments
It will check the folder |
As for the missmatch of state_dict
It is mentioned in some issues, but i forgot which it is |
might be this one #1200 |
I fixed this bug by modifying it: |
Great, so there is no need to change the version of |
Describe the issue
Issue:
When using LoRA fine-tuning to restore from a checkpoint, an error occurs, while there is no issue when not using LoRA fine-tuning to restore from a checkpoint. Can you explain why? How should I modify to save more parameters?
Command:
Log:
Screenshots:
The text was updated successfully, but these errors were encountered: