Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

项目提供的lora没有达到提的效果呀,就给的那几个infer的例子 #6

Closed
Zombiessss opened this issue Apr 19, 2023 · 5 comments

Comments

@Zombiessss
Copy link

image

@SCIR-HI
Copy link
Owner

SCIR-HI commented Apr 19, 2023

您好,感谢您的关注,目前由于beam search等设置,模型对于相同输入的回答每次可能不尽相同,您可以尝试多次运行。此外,由于当前模型训练集大小有限,模型在微调后能力也因此受限,目前我们正在进行更大规模、质量更优的数据收集,以及训练方法上的更新,很快将进行模型的迭代。

@Zombiessss
Copy link
Author

跟beam search没啥关系吧,这效果差的很远啊,那个golden output是真的inference出来的效果吗,如果是的话可以把那个lora的ckpt release下吗

@Chengzhe-Feng
Copy link

我使用提供的lora也得到了类似的结果 请问infer.py中关于temperature等参数的设置与您当时跑示例时一致么
huatuo

@s65b40 s65b40 closed this as completed May 7, 2023
@Gavingx
Copy link

Gavingx commented May 15, 2023

同样的问题。感觉效果跟作者贴出来的图片上的效果差挺多的,试了各种超参的组合,结果好像没什么改变。base_model是llama-7b-hf,lora是作者开放出来的https://huggingface.co/thinksoso/lora-llama-med
image

@zhengorange
Copy link

作者您好,我这里也是出现了同样的问题,是不是您那边放错了lora文件
截屏2023-05-28 00 27 37

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants