New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

python cli_demo.py 16gb电脑内存加载模型直接卡死了 #69

Open

459936800 opened this issue May 27, 2023 · 1 comment

459936800 commented May 27, 2023

ChatGLM-6B
ChatGLM-6B 可以低配置部署VisualGLM-6B 不知道有没有怎么设置？

Contributor

Sleepychord commented May 27, 2023

请阅读readme，里面写了可以使用--quant 4进行低配置运行，我感觉没啥效果损失

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment