You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for your interest in our work! People in this issue show similar problems to your case, and their reason looks like they don't add the delta weight of vicuna back to llama weight to get the final working weight. Note that the vicuna weight you directly download is a delta version. And you need to follow their instruction to add this delta weight back to the original llama weight, to get the final working weight of vicuna. The reason why we need this complex process is that llama doesn't allow us to distribute their weights, so vicuna has to release a delta weight version to bypass this rule
I am using a V100 graphics card (it does not support int8 operations, when I try to run low_resource=True there is an error with cuda_setup).
I put low_resource=False and run it, but I get crossed out and wrong text
I used the right weights (git-lfs clone https://huggingface.co/lmsys/vicuna-13b-delta-v0)
The text was updated successfully, but these errors were encountered: