-
Notifications
You must be signed in to change notification settings - Fork 432
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
项目提供的lora没有达到提的效果呀,就给的那几个infer的例子 #6
Comments
您好,感谢您的关注,目前由于beam search等设置,模型对于相同输入的回答每次可能不尽相同,您可以尝试多次运行。此外,由于当前模型训练集大小有限,模型在微调后能力也因此受限,目前我们正在进行更大规模、质量更优的数据收集,以及训练方法上的更新,很快将进行模型的迭代。 |
跟beam search没啥关系吧,这效果差的很远啊,那个golden output是真的inference出来的效果吗,如果是的话可以把那个lora的ckpt release下吗 |
同样的问题。感觉效果跟作者贴出来的图片上的效果差挺多的,试了各种超参的组合,结果好像没什么改变。base_model是llama-7b-hf,lora是作者开放出来的https://huggingface.co/thinksoso/lora-llama-med。 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The text was updated successfully, but these errors were encountered: