Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

一些问题 #9

Closed
firslov opened this issue Apr 1, 2023 · 3 comments
Closed

一些问题 #9

firslov opened this issue Apr 1, 2023 · 3 comments

Comments

@firslov
Copy link

firslov commented Apr 1, 2023

  1. 朋友，readme里CSDN的link好像是有误的；
  2. 是不是目前大部分finetune都是用lora算法训练的cross attention那部分权重，有没有微调整个模型的？
@liangwq
Copy link
Owner

liangwq commented Apr 1, 2023

  1. 朋友，readme里CSDN的link好像是有误的；
  2. 是不是目前大部分finetune都是用lora算法训练的cross attention那部分权重，有没有微调整个模型的？

是的，现在只放出来lora微调部分，csdn是介绍更全面
fintune整个的其实GLM官方github就有，一般设备调不动，并且对调试要求很高

@liangwq
Copy link
Owner

liangwq commented Apr 1, 2023

glm fintune部分代码：https://github.com/THUDM/GLM-130B

@liangwq liangwq closed this as completed Apr 2, 2023
@firslov
Copy link
Author

firslov commented Apr 3, 2023

readme里csdn的链接还是有问题啊，打开之后是一个发布文章的界面

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@liangwq @firslov