Windows got errpr: RuntimeError: Library cublas64_11.dll is not found or cannot be loaded

[lucasjinreal]

RuntimeError: Library cublas64_11.dll is not found or cannot be loaded

I have installed CUDA and cudnn, the torch loads and use cuda normally.

[ChihTsungLu]

I got the same error .

[lucasjinreal]

Looks like CUDA12 not supported. But install ctranslate2 didn't have a fully automatically building script for users pip install auto build on target lib.

[phineas-pta]

if u want cuda 12 must build ctranslate2 from source

[benjaminchensz]

RuntimeError: Library cublas64_11.dll is not found or cannot be loaded

I have installed CUDA and cudnn, the torch loads and use cuda normally.

See if you can find the cublas64_12.dll and rename it to cublas64_11.dll.

[BBC-Esq]

Or you could just install CUDA 11.8 unless you truly know the difference and can't live without CUDA 12.1?

[FreeTymeKiyan]

Is this really a cuda 12 issue?
I was trying to download cublas from https://developer.nvidia.com/hpc-sdk-downloads but for windows it says

The NVIDIA HPC SDK for Windows will be available at a later date.

It seems to me that windows is just not supported officially. Unless there's some hack that I don't know of.

[phineas-pta]

cublas is included in cuda

[FreeTymeKiyan]

@phineas-pta yeah I actually found the file, cublas64_11.dll, in the CUDA 11.8. I also made sure that the directory is in PATH.

But for some reason it still throws the same error

[FreeTymeKiyan]

My issue was resolved after installing CUDA 11.8 and made sure that

1. nvcc --version shows Cuda compilation tools, release 11.8, V11.8.89
2. my vscode is completely restarted (the terminal wasn't able to pick up the environment variable changes)

[lucasjinreal]

Using insame-faster-whisper, that lib faster than this one.

[BBC-Esq]

I just got a response on the ctranslate2 github "issue" they say that CUDA 12+ is supported if you compile from source, but my question was whether it's possible to have it supported out-of-the-box without having to compile...Anyways, see my prior "issue" on this github regarding "insane" faster whisper and the differences between it and faster-whisper - spoiler, faster-whisper is still faster with everything equal...it just doesn't support the "batching" like "insane" does.

Regarding the CUDA 12 issue, you have to use CUDA 11.8 currently if you pip install faster-whisper (and hence ctranslate2)...unfortunately but hopefully they'll update with CUDA support out-of-the-box as newer PyTorch versions come out.

[szriru]

RuntimeError: Library cublas64_11.dll is not found or cannot be loaded
I have installed CUDA and cudnn, the torch loads and use cuda normally.

See if you can find the cublas64_12.dll and rename it to cublas64_11.dll.

This solved my case.
but I did copy&rename in case I forget I did this.

The file locaton was C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.3\bin\

[RazeBerry]

RuntimeError: Library cublas64_11.dll is not found or cannot be loaded
I have installed CUDA and cudnn, the torch loads and use cuda normally.

See if you can find the cublas64_12.dll and rename it to cublas64_11.dll.

This solved my case. but I did copy&rename in case I forget I did this.

The file locaton was C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.3\bin\

For the rest of us who have CUDA 11, how is this supposed to work? Also suffering from the same problem

[giovanith]

Hello, I also simply did a 'copy and rename'
faster whisper ran without issues after this

[kofeisen]

RuntimeError: Library cublas64_12.dll is not found or cannot be loaded.
'copy and rename' Solve the problem

[lukeewin]

RuntimeError: Library cublas64_12.dll is not found or cannot be loaded. 'copy and rename' Solve the problem

I encountered the same issue.
Are you renaming cublas64_11.dll to cublas64_12.dll?

[kofeisen]

RuntimeError: Library cublas64_12.dll is not found or cannot be loaded. 'copy and rename' Solve the problem

I encountered the same issue. Are you renaming cublas64_11.dll to cublas64_12.dll?

Yes.