New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

跑量化模型4bits可以用CPU推理吗 #57

Open

WingsLong opened this issue Sep 8, 2023 · 1 comment

WingsLong commented Sep 8, 2023

把float16改成float32之后，提示没有GPU设备

RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

Contributor

jameswu2014 commented Sep 11, 2023 •

edited

currently it is not supported.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment