You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for the great work here. While using cudarc on a Windows machine, we ran into the following issue: it does not detect the curand DLL. Here is some more information:
mistralrs-server.exe gguf -m . -f Mistral-7B-Instruct-v0.3-Q6_K.gguf
thread 'main' panicked at C:\Users\[REDACTED]\.cargo\registry\src\index.crates.io-6f17d22bba15001f\cudarc-0.11.3\src\curand\sys\mod.rs:51:9:
Unable to find curand lib under the names ["curand", "curand64", "curand64_12", "curand64_125", "curand64_125_0", "curand64_120_5"]. Please open GitHub issue.
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
We have CUDA version 12.5 on Windows:
$ which curand64_10.dll
/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.5/bin/curand64_10.dll
I think that this may be related to #240, and the solution is as simple as adding curand64_10 to the searchable names? Thank you!
The text was updated successfully, but these errors were encountered:
Cool I'll get a fix in for this. I've noticed this for curand as well. I'm not sure why there is a 10 in the name. But yeah I think we can just add {lib_name}{pointer_width}_10 into the searchable names!
Hello all,
Thanks for the great work here. While using
cudarc
on a Windows machine, we ran into the following issue: it does not detect the curand DLL. Here is some more information:We have CUDA version 12.5 on Windows:
I think that this may be related to #240, and the solution is as simple as adding
curand64_10
to the searchable names? Thank you!The text was updated successfully, but these errors were encountered: