New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

使用lmdeploy框架部署internvl-chat-1.5，输出结果不稳定，精度下降明显，有遇到类似的情况吗？ #187

Open

YangYangTx opened this issue May 21, 2024 · 1 comment

YangYangTx commented May 21, 2024

No description provided.

chengxm1991 commented May 27, 2024

您好想借楼问一下，lmdeploy部署，推理的gpu利用率大概多少？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment