New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

能用llama.cpp 4位量化出来跑跑嘛 #18

Closed

cgisky1980 opened this issue Mar 22, 2023 · 2 comments

cgisky1980 commented Mar 22, 2023

没GPU T_T

Collaborator

mabaochang commented Mar 23, 2023

我们正在研发量化功能，将大大降低推理的硬件需求，预计本周发布

Collaborator

tjadamlee commented Mar 25, 2023

量化模型已经发布，见README.md

tjadamlee closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment