Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

权重转换脚本不支持来自 Facebook 的原版权重 #22

Closed
ShadowPower opened this issue May 17, 2023 · 2 comments
Closed

权重转换脚本不支持来自 Facebook 的原版权重 #22

ShadowPower opened this issue May 17, 2023 · 2 comments

Comments

@ShadowPower
Copy link

使用了项目中的 apply_delta.py 搭配来自 Facebook 的原版权重进行转换
错误如下:
OSError: E:/MetaAI/LLaMA/7B does not appear to have a file named config.json. Checkout 'https://huggingface.co/E:/MetaAI/LLaMA/7B/None' for available files.

原版的权重目录里确实不包含 config.json 文件,请问应如何转换成兼容本项目的版本?

@SparkJiao
Copy link
Collaborator

需要先用HF的脚本把LLaMA的原版权重转成HF版本的:
https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/convert_llama_weights_to_hf.py

然后用apply_delta.py把我们提供的权重和HF版本的LLaMA权重进行合并。

@ShadowPower
Copy link
Author

已经解决了,感谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants