Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to find curand lib under the names ... #242

Closed
EricLBuehler opened this issue May 31, 2024 · 1 comment · Fixed by #243
Closed

Unable to find curand lib under the names ... #242

EricLBuehler opened this issue May 31, 2024 · 1 comment · Fixed by #243

Comments

@EricLBuehler
Copy link

EricLBuehler commented May 31, 2024

Hello all,

Thanks for the great work here. While using cudarc on a Windows machine, we ran into the following issue: it does not detect the curand DLL. Here is some more information:

mistralrs-server.exe gguf -m . -f Mistral-7B-Instruct-v0.3-Q6_K.gguf

thread 'main' panicked at C:\Users\[REDACTED]\.cargo\registry\src\index.crates.io-6f17d22bba15001f\cudarc-0.11.3\src\curand\sys\mod.rs:51:9:
Unable to find curand lib under the names ["curand", "curand64", "curand64_12", "curand64_125", "curand64_125_0", "curand64_120_5"]. Please open GitHub issue.
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

We have CUDA version 12.5 on Windows:

$ which curand64_10.dll
/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.5/bin/curand64_10.dll

I think that this may be related to #240, and the solution is as simple as adding curand64_10 to the searchable names? Thank you!

@coreylowman
Copy link
Owner

Cool I'll get a fix in for this. I've noticed this for curand as well. I'm not sure why there is a 10 in the name. But yeah I think we can just add {lib_name}{pointer_width}_10 into the searchable names!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants