Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

【AWQ_transformers.ipynb】下载facebook-opt-6.7模型到本地再加载报错 #11

Open
sunwrise opened this issue Jan 13, 2024 · 0 comments

Comments

@sunwrise
Copy link

sunwrise commented Jan 13, 2024

作业: fine-tune-quickstart.ipynb

目标:

因网络不稳定,打算把"facebook/opt-6.7b"模型下载到本地后再加载使用,进行量化。

代码如下:

#下载模型
b6e665c761cca3c138e6a088306c841

#加载模型
48da132622d4042f1fb94ef1b8740bc

报错如下:

707458bbf54dedbf62497fa2061f006

经查验本地存储内容为:
e3d6cc50f8e697d51643348763c27d0

完全和官网文件格式不一致,改为直接读取已经存在本地的缓存文件反而没有问题。

问题

这是否说明:用transformers的from_pretrained方法从hf下载的原始模型到本地,用save_pretrained方法保存后,再用from_pretrained从本地指定路径读取这一方法是有使用限制的?

为什么会出现这样的问题?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant