Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] GLM3 的 P-Tuning v2 微调能支持吗 #2773

Closed
shaitao opened this issue Jan 23, 2024 · 2 comments
Closed

[FEATURE] GLM3 的 P-Tuning v2 微调能支持吗 #2773

shaitao opened this issue Jan 23, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@shaitao
Copy link

shaitao commented Jan 23, 2024

https://github.com/THUDM/ChatGLM3/tree/main/finetune_chatmodel_demo
所采用的 P-Tuning v2 训练的模型bin文件

是否能加载,若不支持,将来是否有计划。

@shaitao shaitao added the enhancement New feature or request label Jan 23, 2024
Copy link

dosubot bot commented Jan 23, 2024

🤖

很抱歉,我在Langchain-Chatchat的存储库中没有找到关于GLM3的P-Tuning v2微调的相关信息。为了更好地帮助您,我需要更多的信息。您能否提供一些关于您希望实现的具体功能或者您在使用过程中遇到的问题的详细信息?这将有助于我更准确地找到解决方案。


This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.

@zRzRzRzRzRzRzR zRzRzRzRzRzRzR self-assigned this Jan 24, 2024
@zRzRzRzRzRzRzR
Copy link
Collaborator

不能,因为不是peft结构,chatglm3会重写微调代码,之后他们新的代码调出来的模型就能用了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants