CUDA load error on Windows 10

[morgankohler]

Hey, this is great work. I have been trying to set this up from repo for windows and the biggest problem so far is this error in the cuda load step (ChatRWKV/rwkv_pip_package/src/rwkv/model.py:29):

"CalledProcessError: Command '['where', 'cl']' returned non-zero exit status 1."

I'm not too familiar with low-level cuda programs so having a tough time debugging. Maybe you have some idea? Thanks!

[BlinkDL]

Thank you :) Firstly set os.environ["RWKV_CUDA_ON"] = '0' and find your fastest strategy (no need to compile CUDA and simply works - but preprocessing of context will be 10x slower).

In order to use os.environ["RWKV_CUDA_ON"] = '1' in windows:

1. Install VS 2022 and Visual Studio Build Tools 2022.
2. Reinstall CUDA 11.7 (install CUDA VS extensions).
3. Run python chat.py in "x64 Native Tools Command Prompt for VS 2022" and it should be able to compile the CUDA kernel.

[linonetwo]

Hi, currently https://developer.nvidia.com/cuda-toolkit only have CUDA 12 download.

Can CUDA 12 work for ChatRWKV?