Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

不支持windows #1064

Closed
chenmozhijin opened this issue Sep 27, 2023 · 1 comment
Closed

不支持windows #1064

chenmozhijin opened this issue Sep 27, 2023 · 1 comment
Labels
solved This problem has been already solved.

Comments

@chenmozhijin
Copy link

23/09/27之后pull出现的

Traceback (most recent call last):
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\extras\patches\llama_patch.py", line 13, in <module>
    from flash_attn import flash_attn_func, flash_attn_varlen_func # type: ignore
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ModuleNotFoundError: No module named 'flash_attn'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\train_web.py", line 1, in <module>
    from llmtuner import create_ui
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\__init__.py", line 3, in <module>
    from llmtuner.api import create_app
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\api\__init__.py", line 1, in <module>
    from llmtuner.api.app import create_app
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\api\app.py", line 9, in <module>
    from llmtuner.chat import ChatModel
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\chat\__init__.py", line 1, in <module>
    from llmtuner.chat.stream_chat import ChatModel
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\chat\stream_chat.py", line 8, in <module>
    from llmtuner.tuner.core import get_infer_args, load_model_and_tokenizer
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\tuner\__init__.py", line 1, in <module>
    from llmtuner.tuner.tune import export_model, run_exp
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\tuner\tune.py", line 5, in <module>
    from llmtuner.tuner.core import get_train_args, load_model_and_tokenizer
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\tuner\core\__init__.py", line 2, in <module>
    from llmtuner.tuner.core.loader import load_model_and_tokenizer
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\tuner\core\loader.py", line 28, in <module>
    from llmtuner.extras.patches import llama_patch as LlamaPatches
  File "D:\yy\project\AI\LLaMA-Efficient-Tuning\src\llmtuner\extras\patches\llama_patch.py", line 16, in <module>
    raise ImportError("Please install FlashAttention from https://github.com/Dao-AILab/flash-attention")
ImportError: Please install FlashAttention from https://github.com/Dao-AILab/flash-attention

现在FlashAttention还不支持windows
Dao-AILab/flash-attention#567
Dao-AILab/flash-attention#565
Dao-AILab/flash-attention#553
Dao-AILab/flash-attention#345
安装会报错

PS C:\Users\chen_> pip install flash-attn --no-build-isolation
Looking in indexes: https://mirrors.aliyun.com/pypi/simple
Collecting flash-attn
  Using cached https://mirrors.aliyun.com/pypi/packages/e6/f6/362df2a546a8fa6b19e490786641849844b0192c47aac7337549db0871ef/flash_attn-2.2.5.tar.gz (2.3 MB)
  Preparing metadata (setup.py) ... done
Requirement already satisfied: torch in d:\yy\program\python311\lib\site-packages (from flash-attn) (2.2.0.dev20230922+cu121)
Requirement already satisfied: einops in d:\yy\program\python311\lib\site-packages (from flash-attn) (0.6.1)
Requirement already satisfied: packaging in d:\yy\program\python311\lib\site-packages (from flash-attn) (23.1)
Collecting ninja (from flash-attn)
  Using cached https://mirrors.aliyun.com/pypi/packages/9d/74/71ef16dea18414acf7ca0da7a16e2fcb9f73d7a16d00879aed385840c720/ninja-1.11.1-py2.py3-none-win_amd64.whl (313 kB)
Requirement already satisfied: filelock in d:\yy\program\python311\lib\site-packages (from torch->flash-attn) (3.9.0)
Requirement already satisfied: typing-extensions in d:\yy\program\python311\lib\site-packages (from torch->flash-attn) (4.4.0)
Requirement already satisfied: sympy in d:\yy\program\python311\lib\site-packages (from torch->flash-attn) (1.11.1)
Requirement already satisfied: networkx in d:\yy\program\python311\lib\site-packages (from torch->flash-attn) (3.0rc1)
Requirement already satisfied: jinja2 in d:\yy\program\python311\lib\site-packages (from torch->flash-attn) (3.1.2)
Requirement already satisfied: fsspec in d:\yy\program\python311\lib\site-packages (from torch->flash-attn) (2023.4.0)
Requirement already satisfied: MarkupSafe>=2.0 in d:\yy\program\python311\lib\site-packages (from jinja2->torch->flash-attn) (2.1.2)
Requirement already satisfied: mpmath>=0.19 in d:\yy\program\python311\lib\site-packages (from sympy->torch->flash-attn) (1.2.1)
Building wheels for collected packages: flash-attn
  Building wheel for flash-attn (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [333 lines of output]
      fatal: not a git repository (or any of the parent directories): .git


      torch.__version__  = 2.2.0.dev20230922+cu121


      running bdist_wheel
      D:\yy\Program\python311\Lib\site-packages\torch\utils\cpp_extension.py:502: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
        warnings.warn(msg.format('we could not find ninja.'))
      Guessing wheel URL:  https://github.com/Dao-AILab/flash-attention/releases/download/v2.2.5/flash_attn-2.2.5+cu121torch2.2cxx11abiFALSE-cp311-cp311-win_amd64.whl
      Precompiled wheel not found. Building from source...
      running build
      running build_py
      creating build
      creating build\lib.win-amd64-cpython-311
      creating build\lib.win-amd64-cpython-311\flash_attn
      copying flash_attn\bert_padding.py -> build\lib.win-amd64-cpython-311\flash_attn
      copying flash_attn\flash_attn_interface.py -> build\lib.win-amd64-cpython-311\flash_attn
      copying flash_attn\flash_attn_triton.py -> build\lib.win-amd64-cpython-311\flash_attn
      copying flash_attn\flash_attn_triton_og.py -> build\lib.win-amd64-cpython-311\flash_attn
      copying flash_attn\flash_blocksparse_attention.py -> build\lib.win-amd64-cpython-311\flash_attn
      copying flash_attn\flash_blocksparse_attn_interface.py -> build\lib.win-amd64-cpython-311\flash_attn
      copying flash_attn\fused_softmax.py -> build\lib.win-amd64-cpython-311\flash_attn
      copying flash_attn\__init__.py -> build\lib.win-amd64-cpython-311\flash_attn
      creating build\lib.win-amd64-cpython-311\flash_attn\layers
      copying flash_attn\layers\patch_embed.py -> build\lib.win-amd64-cpython-311\flash_attn\layers
      copying flash_attn\layers\rotary.py -> build\lib.win-amd64-cpython-311\flash_attn\layers
      copying flash_attn\layers\__init__.py -> build\lib.win-amd64-cpython-311\flash_attn\layers
      creating build\lib.win-amd64-cpython-311\flash_attn\losses
      copying flash_attn\losses\cross_entropy.py -> build\lib.win-amd64-cpython-311\flash_attn\losses
      copying flash_attn\losses\__init__.py -> build\lib.win-amd64-cpython-311\flash_attn\losses
      creating build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\baichuan.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\bert.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\bigcode.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\falcon.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\gpt.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\gptj.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\gpt_neox.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\llama.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\opt.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\vit.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      copying flash_attn\models\__init__.py -> build\lib.win-amd64-cpython-311\flash_attn\models
      creating build\lib.win-amd64-cpython-311\flash_attn\modules
      copying flash_attn\modules\block.py -> build\lib.win-amd64-cpython-311\flash_attn\modules
      copying flash_attn\modules\embedding.py -> build\lib.win-amd64-cpython-311\flash_attn\modules
      copying flash_attn\modules\mha.py -> build\lib.win-amd64-cpython-311\flash_attn\modules
      copying flash_attn\modules\mlp.py -> build\lib.win-amd64-cpython-311\flash_attn\modules
      copying flash_attn\modules\__init__.py -> build\lib.win-amd64-cpython-311\flash_attn\modules
      creating build\lib.win-amd64-cpython-311\flash_attn\ops
      copying flash_attn\ops\activations.py -> build\lib.win-amd64-cpython-311\flash_attn\ops
      copying flash_attn\ops\fused_dense.py -> build\lib.win-amd64-cpython-311\flash_attn\ops
      copying flash_attn\ops\layer_norm.py -> build\lib.win-amd64-cpython-311\flash_attn\ops
      copying flash_attn\ops\rms_norm.py -> build\lib.win-amd64-cpython-311\flash_attn\ops
      copying flash_attn\ops\__init__.py -> build\lib.win-amd64-cpython-311\flash_attn\ops
      creating build\lib.win-amd64-cpython-311\flash_attn\utils
      copying flash_attn\utils\benchmark.py -> build\lib.win-amd64-cpython-311\flash_attn\utils
      copying flash_attn\utils\distributed.py -> build\lib.win-amd64-cpython-311\flash_attn\utils
      copying flash_attn\utils\generation.py -> build\lib.win-amd64-cpython-311\flash_attn\utils
      copying flash_attn\utils\pretrained.py -> build\lib.win-amd64-cpython-311\flash_attn\utils
      copying flash_attn\utils\__init__.py -> build\lib.win-amd64-cpython-311\flash_attn\utils
      creating build\lib.win-amd64-cpython-311\flash_attn\ops\triton
      copying flash_attn\ops\triton\cross_entropy.py -> build\lib.win-amd64-cpython-311\flash_attn\ops\triton
      copying flash_attn\ops\triton\k_activations.py -> build\lib.win-amd64-cpython-311\flash_attn\ops\triton
      copying flash_attn\ops\triton\linear.py -> build\lib.win-amd64-cpython-311\flash_attn\ops\triton
      copying flash_attn\ops\triton\mlp.py -> build\lib.win-amd64-cpython-311\flash_attn\ops\triton
      copying flash_attn\ops\triton\rotary.py -> build\lib.win-amd64-cpython-311\flash_attn\ops\triton
      copying flash_attn\ops\triton\__init__.py -> build\lib.win-amd64-cpython-311\flash_attn\ops\triton
      running build_ext
      D:\yy\Program\python311\Lib\site-packages\torch\utils\cpp_extension.py:383: UserWarning: Error checking compiler version for cl: [WinError 2] 系统找不到指定的文件。
        warnings.warn(f'Error checking compiler version for {compiler}: {error}')
      D:\yy\Program\python311\Lib\site-packages\torch\utils\cpp_extension.py:414: UserWarning: The detected CUDA version (12.2) has a minor version mismatch with the version that was used to compile PyTorch (12.1). Most likely this shouldn't be a problem.
        warnings.warn(CUDA_MISMATCH_WARN.format(cuda_str_version, torch.version.cuda))
      building 'flash_attn_2_cuda' extension
      creating build\temp.win-amd64-cpython-311
      creating build\temp.win-amd64-cpython-311\Release
      creating build\temp.win-amd64-cpython-311\Release\csrc
      creating build\temp.win-amd64-cpython-311\Release\csrc\flash_attn
      creating build\temp.win-amd64-cpython-311\Release\csrc\flash_attn\src
      "D:\yy\Program\Microsoft Visual Studio\BuildTools\VC\Tools\MSVC\14.37.32822\bin\HostX86\x64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -IC:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn -IC:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src -IC:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\cutlass\include -ID:\yy\Program\python311\Lib\site-packages\torch\include -ID:\yy\Program\python311\Lib\site-packages\torch\include\torch\csrc\api\include -ID:\yy\Program\python311\Lib\site-packages\torch\include\TH -ID:\yy\Program\python311\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include" -ID:\yy\Program\python311\include -ID:\yy\Program\python311\Include "-ID:\yy\Program\Microsoft Visual Studio\BuildTools\VC\Tools\MSVC\14.37.32822\include" "-ID:\yy\Program\Microsoft Visual Studio\BuildTools\VC\Tools\MSVC\14.37.32822\ATLMFC\include" "-ID:\yy\Program\Microsoft Visual Studio\BuildTools\VC\Auxiliary\VS\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.22621.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\um" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\shared" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\winrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\cppwinrt" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\include\um" /EHsc /Tpcsrc/flash_attn/flash_api.cpp /Fobuild\temp.win-amd64-cpython-311\Release\csrc/flash_attn/flash_api.obj /MD /wd4819 /wd4251 /wd4244 /wd4267 /wd4275 /wd4018 /wd4190 /wd4624 /wd4067 /wd4068 /EHsc -O3 -std=c++17 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=flash_attn_2_cuda -D_GLIBCXX_USE_CXX11_ABI=0 /std:c++17
      cl: 命令行 warning D9002 :忽略未知选项“-O3”
      cl: 命令行 warning D9002 :忽略未知选项“-std=c++17”
      flash_api.cpp
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(434): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(438): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(442): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(446): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(450): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(454): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(458): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(462): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(466): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(470): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(474): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(478): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(482): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(486): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(490): warning C4996: 'cusparseColorInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(494): warning C4996: 'cusparseColorInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(498): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(502): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(759): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(774): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(789): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(804): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(819): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(834): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(849): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(864): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(879): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(894): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(895): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(910): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(911): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(926): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(927): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(942): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(943): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(959): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(962): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(978): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(981): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(997): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1000): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1016): warning C4996: 'bsrsv2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1019): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1113): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1130): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1147): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1164): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1181): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1198): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1215): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1232): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1249): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1266): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1267): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1284): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1285): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1302): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1303): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1320): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1321): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1339): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1344): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1362): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1367): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1385): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1390): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1408): warning C4996: 'bsrsm2Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1413): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1423): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1431): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1439): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1447): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1455): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1467): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1479): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1491): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1503): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1515): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1527): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1539): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1551): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1563): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1564): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1576): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1577): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1589): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1590): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1602): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1603): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1615): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1616): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1628): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1629): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1641): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1642): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1654): warning C4996: 'csrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1655): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1661): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1669): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1677): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1685): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1693): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1707): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1721): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1735): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1749): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1763): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1777): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1791): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1805): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1819): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1820): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1834): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1835): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1849): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1850): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1864): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1865): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1879): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1880): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1894): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1895): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1909): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1910): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1924): warning C4996: 'bsrilu02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1925): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1931): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1943): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1955): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1967): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1979): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(1991): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2003): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2015): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2027): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2039): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2040): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2052): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2053): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2065): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2066): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2078): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2079): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2091): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2092): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2104): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2105): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2117): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2118): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2130): warning C4996: 'csric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2131): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2137): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2151): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2165): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2179): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2193): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2207): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2221): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2235): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2249): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2263): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2264): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2278): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2279): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2293): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2294): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2308): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2309): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2323): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2324): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2338): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2339): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2354): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2355): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2369): warning C4996: 'bsric02Info_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(2370): warning C4996: 'cusparseSolvePolicy_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(3043): warning C4996: 'cusparseColorInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(3058): warning C4996: 'cusparseColorInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(3073): warning C4996: 'cusparseColorInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(3088): warning C4996: 'cusparseColorInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4142): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4154): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4166): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4178): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4191): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4204): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4217): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4230): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4243): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4256): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4269): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4282): warning C4996: 'csru2csrInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4591): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4609): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4625): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4642): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4658): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4673): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4690): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4707): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4722): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4743): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4764): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4783): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4803): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4823): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4841): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4861): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4881): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include\cusparse.h(4899): warning C4996: 'pruneInfo_t': The type will be removed in the next major release
      "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\bin\nvcc" -c csrc/flash_attn/src/flash_bwd_hdim128_bf16_sm80.cu -o build\temp.win-amd64-cpython-311\Release\csrc/flash_attn/src/flash_bwd_hdim128_bf16_sm80.obj -IC:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn -IC:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src -IC:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\cutlass\include -ID:\yy\Program\python311\Lib\site-packages\torch\include -ID:\yy\Program\python311\Lib\site-packages\torch\include\torch\csrc\api\include -ID:\yy\Program\python311\Lib\site-packages\torch\include\TH -ID:\yy\Program\python311\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\include" -ID:\yy\Program\python311\include -ID:\yy\Program\python311\Include "-ID:\yy\Program\Microsoft Visual Studio\BuildTools\VC\Tools\MSVC\14.37.32822\include" "-ID:\yy\Program\Microsoft Visual Studio\BuildTools\VC\Tools\MSVC\14.37.32822\ATLMFC\include" "-ID:\yy\Program\Microsoft Visual Studio\BuildTools\VC\Auxiliary\VS\include" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.22621.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\um" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\shared" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\winrt" "-IC:\Program Files (x86)\Windows Kits\10\\include\10.0.22621.0\\cppwinrt" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.8\include\um" -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcompiler /EHsc -Xcompiler /wd4068 -Xcompiler /wd4067 -Xcompiler /wd4624 -Xcompiler /wd4190 -Xcompiler /wd4018 -Xcompiler /wd4275 -Xcompiler /wd4267 -Xcompiler /wd4244 -Xcompiler /wd4251 -Xcompiler /wd4819 -Xcompiler /MD -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 --threads 4 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=flash_attn_2_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 --use-local-env
      flash_bwd_hdim128_bf16_sm80.cu
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_HALF_OPERATORS__”(用“/U__CUDA_NO_HALF_OPERATORS__”)
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_HALF_CONVERSIONS__”(用“/U__CUDA_NO_HALF_CONVERSIONS__”)
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_HALF2_OPERATORS__”(用“/U__CUDA_NO_HALF2_OPERATORS__”)
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_BFLOAT16_CONVERSIONS__”(用“/U__CUDA_NO_BFLOAT16_CONVERSIONS__”)
      flash_bwd_hdim128_bf16_sm80.cu
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_HALF_OPERATORS__”(用“/U__CUDA_NO_HALF_OPERATORS__”)
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_HALF_CONVERSIONS__”(用“/U__CUDA_NO_HALF_CONVERSIONS__”)
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_HALF2_OPERATORS__”(用“/U__CUDA_NO_HALF2_OPERATORS__”)
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_BFLOAT16_CONVERSIONS__”(用“/U__CUDA_NO_BFLOAT16_CONVERSIONS__”)
      flash_bwd_hdim128_bf16_sm80.cu
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_HALF_OPERATORS__”(用“/U__CUDA_NO_HALF_OPERATORS__”)
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_HALF_CONVERSIONS__”(用“/U__CUDA_NO_HALF_CONVERSIONS__”)
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_HALF2_OPERATORS__”(用“/U__CUDA_NO_HALF2_OPERATORS__”)
      cl: 命令行 warning D9025 :正在重写“/D__CUDA_NO_BFLOAT16_CONVERSIONS__”(用“/U__CUDA_NO_BFLOAT16_CONVERSIONS__”)
      flash_bwd_hdim128_bf16_sm80.cu
      C:/Program Files (x86)/Windows Kits/10/include/10.0.22621.0/ucrt\fenv.h(113): warning #550-D: variable "_Ans" was set but never used
                    double _Ans = 0.0;
                           ^

      Remark: The warnings can be suppressed with "-diag-suppress <warning-number>"

      C:/Program Files (x86)/Windows Kits/10/include/10.0.22621.0/ucrt\fenv.h(113): warning #550-D: variable "_Ans" was set but never used
                    double _Ans = 0.0;
                           ^

      Remark: The warnings can be suppressed with "-diag-suppress <warning-number>"

      tmpxft_00002d44_00000000-7_flash_bwd_hdim128_bf16_sm80.compute_90.cudafe1.cpp
      C:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src\flash_bwd_launch_template.h(234): error C2975: “kHeadDim_”:“Flash_bwd_kernel_traits”的模板参数无效，应为编译时常量表达式
      C:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src\kernel_traits.h(186): note: 参见“kHeadDim_”的声明
      C:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src\flash_bwd_hdim128_bf16_sm80.cu(9): note: 查看对正在编译的函数 模板 实例化“void run_mha_bwd_hdim128<cutlass::bfloat16_t>(Flash_bwd_params &,cudaStream_t,const bool)”的引用
      C:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src\flash_bwd_launch_template.h(234): error C2975: “kHeadDim_”:“Flash_bwd_kernel_traits”的模板参数无效，应为编译时常量表达式
      C:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src\kernel_traits.h(186): note: 参见“kHeadDim_”的声明
      C:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src\flash_bwd_launch_template.h(234): error C2975: “kHeadDim_”:“Flash_bwd_kernel_traits”的模板参数无效，应为编译时常量表达式
      C:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src\kernel_traits.h(186): note: 参见“kHeadDim_”的声明
      C:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src\flash_bwd_launch_template.h(234): error C2975: “kHeadDim_”:“Flash_bwd_kernel_traits”的模板参数无效，应为编译时常量表达式
      C:\Users\chen_\AppData\Local\Temp\pip-install-c2yir9hr\flash-attn_542bd76ba429436bb95f6c0e628ec2c9\csrc\flash_attn\src\kernel_traits.h(186): note: 参见“kHeadDim_”的声明
      error: command 'C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin\\nvcc.exe' failed with exit code 4294967295
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for flash-attn
  Running setup.py clean for flash-attn
Failed to build flash-attn
ERROR: Could not build wheels for flash-attn, which is required to install pyproject.toml-based projects
@hiyouga
Copy link
Owner

hiyouga commented Sep 27, 2023

fixed

@hiyouga hiyouga added the solved This problem has been already solved. label Sep 27, 2023
sangttruong pushed a commit to painkillernhat/LLaMA-Factory that referenced this issue May 9, 2024
@hiyouga
fix hiyouga#1064
6e33675
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
solved This problem has been already solved.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hiyouga @chenmozhijin