does candle support nvidia 2080ti on windows 11?

[kulame]

i try to use 2080ti to inference, but it raise error.

Error: DriverError(CUDA_ERROR_INVALID_PTX, "a PTX JIT compilation failed") when loading is_u32_f32

[LaurentMazare]

Yes it should work well on 2080ti, I use it on my rtx 2080 without any issue. This kind of error usually has to do with the cuda installation being incorrect (I think it happens mostly to windows users so far).

[kulame]

Yes, I am working under Windows.

PS C:\>  nvidia-smi --query-gpu=name,compute_cap,driver_version --format=csv
NVIDIA GeForce RTX 2080 Ti, 7.5, 551.86

PS C:\> nvcc -V
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Thu_Mar_28_02:30:10_Pacific_Daylight_Time_2024
Cuda compilation tools, release 12.4, V12.4.131
Build cuda_12.4.r12.4/compiler.34097967_0

my cuda is 12.4 on windows.
Are there any solutions?