New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Request] Please generate Llama-2-7b-chat-hf-q4f16_1-cuda.dll #39

Closed

ParaN3xus opened this issue Nov 18, 2023 · 2 comments

ParaN3xus commented Nov 18, 2023

I want to use mlc-llm on windows with cuda. I have compiled mlc_chat_cli.exe with cuda enabled, but I still need this dll to run llama.

thomascatlee commented Mar 6, 2024

mlc_chat_cli应该是没有后续支持了，看一下#89号issue的描述。

Author

ParaN3xus commented Mar 12, 2024

Thank you

ParaN3xus closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment