Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请教一下如何在加载模型后实时更新lora？ #3735

Closed
1 task done
SandroChen opened this issue May 14, 2024 · 3 comments
Closed
1 task done

请教一下如何在加载模型后实时更新lora？ #3735

SandroChen opened this issue May 14, 2024 · 3 comments
Labels
wontfix This will not be worked on

Comments

@SandroChen
Copy link

Reminder

  • I have read the README and searched the existing issues.

Reproduction

假设我有1个pretrain的模型、3个针对不同数据集sft的lora参数，请问我可以在加载模型后，根据场景需求，实时替换lora吗？如果可以这样实现的话，可以节省相当一部分机器资源。

Expected behavior

No response

System Info

No response

Others

No response
@hiyouga hiyouga added the pending This problem is yet to be addressed. label May 14, 2024
@hiyouga
Copy link
Owner

hiyouga commented May 14, 2024

目前还不支持，以后可能会支持

@dogvane
Copy link

dogvane commented May 16, 2024

我记得在公众号里看到过一篇文章，一个lora算法，推理时先在base模型走一遍，然后再在lora上走一遍，这样就可以适配一个基础模型搭配不同lora业务场景。

@Essence9999
Copy link

楼主看一下slora这篇文章，可能对你有启发

@hiyouga hiyouga added wontfix This will not be worked on and removed pending This problem is yet to be addressed. labels May 29, 2024
@hiyouga hiyouga closed this as not planned Won't fix, can't repro, duplicate, stale May 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
wontfix This will not be worked on
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@dogvane @hiyouga @SandroChen @Essence9999