-
Notifications
You must be signed in to change notification settings - Fork 798
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature/longlora #1346
Feature/longlora #1346
Conversation
Wow, this is a huge PR! Thanks for working on that!
What do you think? |
HI @rasbt, I'm closing this because I've seen that there are some unrelated histories containing also commits regarding the |
I think it might have been possible to rebase, but all good.
|
This PR introduces LongLora as in #1237 for both the LoRa and full fine-tuning, while also enabling it during generation.