Difficulty trying to install sageattention for comfyUI

[viper968]

command run: "$PYTHON_PATH" -m pip install --upgrade --no-build-isolation git+https://github.com/thu-ml/SageAttention --no-cache-dir --no-warn-script-location --timeout=1000 --retries 200 --use-pep517

full command output:

Collecting git+https://github.com/thu-ml/SageAttention                                                                                                                                                                                       
  Cloning https://github.com/thu-ml/SageAttention to /tmp/pip-req-build-s0uvmbbk                                                                                                                                                             
  Running command git clone --filter=blob:none --quiet https://github.com/thu-ml/SageAttention /tmp/pip-req-build-s0uvmbbk                                                                                                                   
  Resolved https://github.com/thu-ml/SageAttention to commit 0f9da83e6038f8330c195cc4bda7f9008a42f679                                                                                                                                        
  Preparing metadata (pyproject.toml) ... done                                                                                                                                                                                               
Building wheels for collected packages: sageattention                                                                                                                                                                                        
  Building wheel for sageattention (pyproject.toml) ... error                                                                                                                                                                                
  error: subprocess-exited-with-error                                                                                                                                                                                                        
                                                                                                                                                                                                                                             
  × Building wheel for sageattention (pyproject.toml) did not run successfully.                                                                                                                                                              
  │ exit code: 1                                                                                                                                                                                                                             
  ╰─> [165 lines of output]                                                                                                                                                                                                                  
      /media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.                                                                                                                    
        import pynvml  # type: ignore[import]                                                                                                                                                                                                
      Target compute capabilities: {'8.6'}                                                                                                                                                                                                   
      running bdist_wheel                                                                                                                                                                                                                    
      running build                                                                                                                                                                                                                          
      running build_py
      creating build/lib.linux-x86_64-cpython-312/sageattention
      copying sageattention/sm90_compile.py -> build/lib.linux-x86_64-cpython-312/sageattention
      copying sageattention/sm89_compile.py -> build/lib.linux-x86_64-cpython-312/sageattention
      copying sageattention/sm80_compile.py -> build/lib.linux-x86_64-cpython-312/sageattention
      copying sageattention/quant.py -> build/lib.linux-x86_64-cpython-312/sageattention
      copying sageattention/fa3_wrapper.py -> build/lib.linux-x86_64-cpython-312/sageattention
      copying sageattention/core.py -> build/lib.linux-x86_64-cpython-312/sageattention
      copying sageattention/__init__.py -> build/lib.linux-x86_64-cpython-312/sageattention
      creating build/lib.linux-x86_64-cpython-312/sageattention/triton
      copying sageattention/triton/quant_per_thread.py -> build/lib.linux-x86_64-cpython-312/sageattention/triton
      copying sageattention/triton/quant_per_block_varlen.py -> build/lib.linux-x86_64-cpython-312/sageattention/triton
      copying sageattention/triton/quant_per_block.py -> build/lib.linux-x86_64-cpython-312/sageattention/triton
      copying sageattention/triton/attn_qk_int8_per_block_causal_varlen.py -> build/lib.linux-x86_64-cpython-312/sageattention/triton
      copying sageattention/triton/attn_qk_int8_per_block_causal.py -> build/lib.linux-x86_64-cpython-312/sageattention/triton
      copying sageattention/triton/attn_qk_int8_per_block.py -> build/lib.linux-x86_64-cpython-312/sageattention/triton
      copying sageattention/triton/attn_qk_int8_block_varlen.py -> build/lib.linux-x86_64-cpython-312/sageattention/triton
      copying sageattention/triton/__init__.py -> build/lib.linux-x86_64-cpython-312/sageattention/triton
      running build_ext
      W1111 21:56:26.048000 27660 torch/utils/cpp_extension.py:521] The detected CUDA version (12.6) has a minor version mismatch with the version that was used to compile PyTorch (12.8). Most likely this shouldn't be a problem.
      W1111 21:56:26.048000 27660 torch/utils/cpp_extension.py:531] There are no g++ version bounds defined for CUDA version 12.6
      building 'sageattention._qattn_sm80' extension
      creating /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._qattn_sm80/csrc/qattn
      building 'sageattention._fused' extension
      creating /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._fused/csrc/fused
      [1/2] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._qattn_sm80/csrc/qattn/qk_int_sv_f16_cuda_sm80.o.d -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/usr/local/cuda/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/include -I/usr/local/include/python3.12 -c -c /tmp/pip-req-build-s0uvmbbk/csrc/qattn/qk_int_sv_f16_cuda_sm80.cu -o /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._qattn_sm80/csrc/qattn/qk_int_sv_f16_cuda_sm80.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=1 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_qattn_sm80
      FAILED: [code=1] /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._qattn_sm80/csrc/qattn/qk_int_sv_f16_cuda_sm80.o
      /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._qattn_sm80/csrc/qattn/qk_int_sv_f16_cuda_sm80.o.d -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/usr/local/cuda/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/include -I/usr/local/include/python3.12 -c -c /tmp/pip-req-build-s0uvmbbk/csrc/qattn/qk_int_sv_f16_cuda_sm80.cu -o /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._qattn_sm80/csrc/qattn/qk_int_sv_f16_cuda_sm80.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=1 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_qattn_sm80
      In file included from /usr/local/cuda/include/cuda_runtime.h:82,
                       from <command-line>:
      /usr/local/cuda/include/crt/host_config.h:143:2: error: #error -- unsupported GNU version! gcc versions later than 13 are not supported! The nvcc flag '-allow-unsupported-compiler' can be used to override this version check; however, using an unsupported host compiler may cause compilation failure or incorrect run time execution. Use at your own risk.
        143 | #error -- unsupported GNU version! gcc versions later than 13 are not supported! The nvcc flag '-allow-unsupported-compiler' can be used to override this version check; however, using an unsupported host compiler may cause compilation failure or incorrect run time execution. Use at your own risk.
            |  ^~~~~
      In file included from /tmp/pip-req-build-s0uvmbbk/csrc/qattn/qk_int_sv_f16_cuda_sm80.cu:17:
      /tmp/pip-req-build-s0uvmbbk/csrc/qattn/../utils.cuh:36:37: warning: backslash-newline at end of file
         36 | #define CHECK_LASTDIM_CONTIGUOUS(x) \
      In file included from /usr/local/cuda/include/cuda_runtime.h:82,
                       from <command-line>:
      /usr/local/cuda/include/crt/host_config.h:143:2: error: #error -- unsupported GNU version! gcc versions later than 13 are not supported! The nvcc flag '-allow-unsupported-compiler' can be used to override this version check; however, using an unsupported host compiler may cause compilation failure or incorrect run time execution. Use at your own risk.
        143 | #error -- unsupported GNU version! gcc versions later than 13 are not supported! The nvcc flag '-allow-unsupported-compiler' can be used to override this version check; however, using an unsupported host compiler may cause compilation failure or incorrect run time execution. Use at your own risk.
            |  ^~~~~
      In file included from /tmp/pip-req-build-s0uvmbbk/csrc/qattn/qk_int_sv_f16_cuda_sm80.cu:17:
      /tmp/pip-req-build-s0uvmbbk/csrc/qattn/../utils.cuh:36:37: warning: backslash-newline at end of file
         36 | #define CHECK_LASTDIM_CONTIGUOUS(x) \
      fatal   : Could not open input file /tmp/tmpxft_00006c35_00000000-7_qk_int_sv_f16_cuda_sm80.cpp1.ii
      [1/2] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._fused/csrc/fused/fused.o.d -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/usr/local/cuda/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/include -I/usr/local/include/python3.12 -c -c /tmp/pip-req-build-s0uvmbbk/csrc/fused/fused.cu -o /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._fused/csrc/fused/fused.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=1 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_fused
      FAILED: [code=1] /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._fused/csrc/fused/fused.o
      /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._fused/csrc/fused/fused.o.d -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/usr/local/cuda/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/include -I/usr/local/include/python3.12 -c -c /tmp/pip-req-build-s0uvmbbk/csrc/fused/fused.cu -o /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._fused/csrc/fused/fused.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=1 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_fused
      In file included from /usr/local/cuda/include/cuda_runtime.h:82,
                       from <command-line>:
      /usr/local/cuda/include/crt/host_config.h:143:2: error: #error -- unsupported GNU version! gcc versions later than 13 are not supported! The nvcc flag '-allow-unsupported-compiler' can be used to override this version check; however, using an unsupported host compiler may cause compilation failure or incorrect run time execution. Use at your own risk.
        143 | #error -- unsupported GNU version! gcc versions later than 13 are not supported! The nvcc flag '-allow-unsupported-compiler' can be used to override this version check; however, using an unsupported host compiler may cause compilation failure or incorrect run time execution. Use at your own risk.
            |  ^~~~~
      In file included from /tmp/pip-req-build-s0uvmbbk/csrc/fused/fused.cu:21:
      /tmp/pip-req-build-s0uvmbbk/csrc/fused/../utils.cuh:36:37: warning: backslash-newline at end of file
         36 | #define CHECK_LASTDIM_CONTIGUOUS(x) \
      In file included from /usr/local/cuda/include/cuda_runtime.h:82,
                       from <command-line>:
      /usr/local/cuda/include/crt/host_config.h:143:2: error: #error -- unsupported GNU version! gcc versions later than 13 are not supported! The nvcc flag '-allow-unsupported-compiler' can be used to override this version check; however, using an unsupported host compiler may cause compilation failure or incorrect run time execution. Use at your own risk.
        143 | #error -- unsupported GNU version! gcc versions later than 13 are not supported! The nvcc flag '-allow-unsupported-compiler' can be used to override this version check; however, using an unsupported host compiler may cause compilation failure or incorrect run time execution. Use at your own risk.
            |  ^~~~~
      In file included from /tmp/pip-req-build-s0uvmbbk/csrc/fused/fused.cu:21:
      /tmp/pip-req-build-s0uvmbbk/csrc/fused/../utils.cuh:36:37: warning: backslash-newline at end of file
         36 | #define CHECK_LASTDIM_CONTIGUOUS(x) \
      fatal   : Could not open input file /tmp/tmpxft_00006c32_00000000-7_fused.cpp1.ii
      [2/2] c++ -MMD -MF /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._fused/csrc/fused/pybind.o.d -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O3 -Wall -fPIC -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/usr/local/cuda/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/include -I/usr/local/include/python3.12 -c -c /tmp/pip-req-build-s0uvmbbk/csrc/fused/pybind.cpp -o /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._fused/csrc/fused/pybind.o -g -O3 -fopenmp -lgomp -std=c++17 -DENABLE_BF16 -D_GLIBCXX_USE_CXX11_ABI=1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_fused
      ninja: build stopped: subcommand failed.
      [2/2] c++ -MMD -MF /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._qattn_sm80/csrc/qattn/pybind_sm80.o.d -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O3 -Wall -fPIC -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/usr/local/cuda/include -I/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/include -I/usr/local/include/python3.12 -c -c /tmp/pip-req-build-s0uvmbbk/csrc/qattn/pybind_sm80.cpp -o /tmp/pip-req-build-s0uvmbbk/build/temp.linux-x86_64-cpython-312/sageattention._qattn_sm80/csrc/qattn/pybind_sm80.o -g -O3 -fopenmp -lgomp -std=c++17 -DENABLE_BF16 -D_GLIBCXX_USE_CXX11_ABI=1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_qattn_sm80
      ninja: build stopped: subcommand failed.
      Traceback (most recent call last):
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2597, in _run_ninja_build
          subprocess.run(
        File "/usr/local/lib/python3.12/subprocess.py", line 571, in run
          raise CalledProcessError(retcode, process.args,
      subprocess.CalledProcessError: Command '['ninja', '-v', '-j', '32']' returned non-zero exit status 1.
      
      The above exception was the direct cause of the following exception:
      
      Traceback (most recent call last):
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
          main()
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
          json_out["return_val"] = hook(**hook_input["kwargs"])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel
          return _build_backend().build_wheel(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/build_meta.py", line 435, in build_wheel
          return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/build_meta.py", line 423, in _build
          return self._build_with_temp_dir(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/build_meta.py", line 404, in _build_with_temp_dir
          self.run_setup()
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/build_meta.py", line 317, in run_setup
          exec(code, locals())
        File "<string>", line 268, in <module>
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/__init__.py", line 115, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
          return run_commands(dist)
                 ^^^^^^^^^^^^^^^^^^
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
          dist.run_commands()
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
          self.run_command(cmd)
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/dist.py", line 1102, in run_command
          super().run_command(command)
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
          cmd_obj.run()
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py", line 370, in run
          self.run_command("build")
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
          self.distribution.run_command(command)
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/dist.py", line 1102, in run_command
          super().run_command(command)
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
          cmd_obj.run()
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 135, in run
          self.run_command(cmd_name)
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
          self.distribution.run_command(command)
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/dist.py", line 1102, in run_command
          super().run_command(command)
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
          cmd_obj.run()
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 96, in run
          _build_ext.run(self)
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
          self.build_extensions()
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 1082, in build_extensions
          build_ext.build_extensions(self)
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 482, in build_extensions
          self._build_extensions_parallel()
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 505, in _build_extensions_parallel
          fut.result()
        File "/usr/local/lib/python3.12/concurrent/futures/_base.py", line 456, in result
          return self.__get_result()
                 ^^^^^^^^^^^^^^^^^^^
        File "/usr/local/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
          raise self._exception
        File "/usr/local/lib/python3.12/concurrent/futures/thread.py", line 59, in run
          result = self.fn(*self.args, **self.kwargs)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "<string>", line 263, in build_extension
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 261, in build_extension
          _build_ext.build_extension(self, ext)
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 565, in build_extension
          objects = self.compiler.compile(
                    ^^^^^^^^^^^^^^^^^^^^^^
        File "<string>", line 254, in compile_new
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 866, in unix_wrap_ninja_compile
          _write_ninja_file_and_compile_objects(
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2223, in _write_ninja_file_and_compile_objects
          _run_ninja_build(
        File "/media/2TB/misc_apps/Linux/AI_TEST/generation_test/ComfyUI-Easy-Install/python_embeded/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2614, in _run_ninja_build
          raise RuntimeError(message) from e
      RuntimeError: Error compiling objects for extension

i am unsure if im doing something wrong or if there is an error with something else, if any extra info is needed to help just ask

[VA7ODR]

I don't think it's just ComfyUI that's broken. I have a venv (also for ComfyUI) But no matter what sageattention can't find torch when it's trying to build the wheel, but torch is there 100%. So regardless of what is running in the venv, I can't install sageattention on Ubuntu 24.04 with Python3.12.3.

james@james-XPS-17-9710:~$ python3 -m venv test-venv
james@james-XPS-17-9710:~$ source test-venv/bin/activate
(test-venv) james@james-XPS-17-9710:~$ pip install --upgrade pip
Requirement already satisfied: pip in ./test-venv/lib/python3.13t/site-packages (24.2)
Collecting pip
  Using cached pip-25.3-py3-none-any.whl.metadata (4.7 kB)
Using cached pip-25.3-py3-none-any.whl (1.8 MB)
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 24.2
    Uninstalling pip-24.2:
      Successfully uninstalled pip-24.2
Successfully installed pip-25.3
(test-venv) james@james-XPS-17-9710:~$ pip install -U sageattention
Collecting sageattention
  Using cached sageattention-2.2.0.tar.gz (67 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [20 lines of output]
      Traceback (most recent call last):
        File "/home/james/test-venv/lib/python3.13t/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
          main()
          ~~~~^^
        File "/home/james/test-venv/lib/python3.13t/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
          json_out["return_val"] = hook(**hook_input["kwargs"])
                                   ~~~~^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/james/test-venv/lib/python3.13t/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
          return hook(config_settings)
        File "/tmp/pip-build-env-rgfusfq4/overlay/lib/python3.13t/site-packages/setuptools/build_meta.py", line 332, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-rgfusfq4/overlay/lib/python3.13t/site-packages/setuptools/build_meta.py", line 302, in _get_build_requires
          self.run_setup()
          ~~~~~~~~~~~~~~^^
        File "/tmp/pip-build-env-rgfusfq4/overlay/lib/python3.13t/site-packages/setuptools/build_meta.py", line 318, in run_setup
          exec(code, locals())
          ~~~~^^^^^^^^^^^^^^^^
        File "<string>", line 36, in <module>
      ModuleNotFoundError: No module named 'torch'
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed to build 'sageattention' when getting requirements to build wheel
(test-venv) james@james-XPS-17-9710:~$ 

[klzsysy]

I don't think it's just ComfyUI that's broken. I have a venv (also for ComfyUI) But no matter what sageattention can't find torch when it's trying to build the wheel, but torch is there 100%. So regardless of what is running in the venv, I can't install sageattention on Ubuntu 24.04 with Python3.12.3.

james@james-XPS-17-9710:$ python3 -m venv test-venv
james@james-XPS-17-9710:$ source test-venv/bin/activate
(test-venv) james@james-XPS-17-9710:$ pip install --upgrade pip
Requirement already satisfied: pip in ./test-venv/lib/python3.13t/site-packages (24.2)
Collecting pip
Using cached pip-25.3-py3-none-any.whl.metadata (4.7 kB)
Using cached pip-25.3-py3-none-any.whl (1.8 MB)
Installing collected packages: pip
Attempting uninstall: pip
Found existing installation: pip 24.2
Uninstalling pip-24.2:
Successfully uninstalled pip-24.2
Successfully installed pip-25.3
(test-venv) james@james-XPS-17-9710:$ pip install -U sageattention
Collecting sageattention
Using cached sageattention-2.2.0.tar.gz (67 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... error
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [20 lines of output]
Traceback (most recent call last):
File "/home/james/test-venv/lib/python3.13t/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in
main()
~~~~^^
File "/home/james/test-venv/lib/python3.13t/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
json_out["return_val"] = hook(**hook_input["kwargs"])
~~~~^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/james/test-venv/lib/python3.13t/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
return hook(config_settings)
File "/tmp/pip-build-env-rgfusfq4/overlay/lib/python3.13t/site-packages/setuptools/build_meta.py", line 332, in get_requires_for_build_wheel
return self._get_build_requires(config_settings, requirements=[])
~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-rgfusfq4/overlay/lib/python3.13t/site-packages/setuptools/build_meta.py", line 302, in _get_build_requires
self.run_setup()
~~~~~~~~~~~~~~^^
File "/tmp/pip-build-env-rgfusfq4/overlay/lib/python3.13t/site-packages/setuptools/build_meta.py", line 318, in run_setup
exec(code, locals())
~~~~^^^^^^^^^^^^^^^^
File "", line 36, in
ModuleNotFoundError: No module named 'torch'
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed to build 'sageattention' when getting requirements to build wheel
(test-venv) james@james-XPS-17-9710:~$

add pip args --no-build-isolation