New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于用vllm加速baichuan2的问题 #247

Open

venxzw opened this issue Oct 24, 2023 · 0 comments

venxzw commented Oct 24, 2023

请问各位大佬，我在用该框架中的vllm加速baichuan2-13b时，按照步骤来创建了vllm的环境和依赖，运行后一直卡在这很久，但显存又在慢慢增加，是怎么回事呢？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment