New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

合并 Lora 和模型 #65

Open

ziwang-com opened this issue Jun 3, 2023 · 0 comments

Owner

ziwang-com commented Jun 3, 2023

oobabooga/text-generation-webui#2474

是否可以添加一个选项来将 Lora 与基本模型合并？从本地目录。因为有时它很方便。由于用于合并 Lora 和模型的现有脚本在 Windows 中不起作用.如果它们有效，不仅适用于普通用户，而且适用于该领域训练有素的人。但是，据我了解，Webui 是针对普通用户的，进一步扩展其功能会很好。

脚本在windoze上运行良好（从ooba env运行）

我试图在这里发布脚本，但 github 格式很糟糕。无论如何，寻找merge_peft_adapters.py

https://github.com/briancabbott/ChatNow
https://github.com/bigcode-project/starcoder
https://github.com/mzbac/qlora-fine-tune

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment