Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fail to install kaldifeat in conda #49

Open
boji123 opened this issue Aug 2, 2022 · 25 comments
Open

fail to install kaldifeat in conda #49

boji123 opened this issue Aug 2, 2022 · 25 comments

Comments

@boji123
Copy link

boji123 commented Aug 2, 2022

pip install kaldifeat
Looking in indexes: http://mirrors.cloud.tencent.com/pypi/simple
Collecting kaldifeat
Using cached http://mirrors.cloud.tencent.com/pypi/packages/2d/7b/0a5c9254de6a62cdca7bea829bd8d5d646e18508d34f9214f048ee003fed/kaldifeat-1.17.tar.gz (477 kB)
Preparing metadata (setup.py) ... done
Building wheels for collected packages: kaldifeat
Building wheel for kaldifeat (setup.py) ... -

error
error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [184 lines of output]
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-cpython-38
creating build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/offline_feature.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/online_feature.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/fbank.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/mfcc.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/plp.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/init.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/spectrogram.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
running build_ext
Setting PYTHON_EXECUTABLE to /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/python3.8
For fast compilation, run:
export KALDIFEAT_MAKE_ARGS="-j"; python setup.py install
build command is:

                  cd build/temp.linux-x86_64-cpython-38
  
                  cmake -DCMAKE_BUILD_TYPE=Release -DPYTHON_EXECUTABLE=/cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/python3.8 /tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783
  
  
                  make  _kaldifeat
  
  -- The C compiler identification is GNU 11.3.0
  -- The CXX compiler identification is GNU 11.3.0
  -- Detecting C compiler ABI info
  -- Detecting C compiler ABI info - done
  -- Check for working C compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/cc - skipped
  -- Detecting C compile features
  -- Detecting C compile features - done
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Check for working CXX compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/c++ - skipped
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  -- C++ Standard version: 14
  -- Downloading pybind11
  -- pybind11 is downloaded to /tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/_deps/pybind11-src
  -- pybind11 v2.9.2
  -- Found PythonInterp: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/python3.8 (found version "3.8.13")
  -- Found PythonLibs: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/libpython3.8.so
  -- Performing Test HAS_FLTO
  -- Performing Test HAS_FLTO - Success
  -- Python executable: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/python3.8
  -- Looking for pthread.h
  -- Looking for pthread.h - found
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
  -- Looking for pthread_create in pthreads
  -- Looking for pthread_create in pthreads - not found
  -- Looking for pthread_create in pthread
  -- Looking for pthread_create in pthread - found
  -- Found Threads: TRUE
  -- Found CUDA: /cfs/user/burkliu/dev/anaconda3/envs/k2_m (found version "11.7")
  -- The CUDA compiler identification is NVIDIA 11.7.64
  -- Detecting CUDA compiler ABI info
  -- Detecting CUDA compiler ABI info - done
  -- Check for working CUDA compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/nvcc - skipped
  -- Detecting CUDA compile features
  -- Detecting CUDA compile features - done
  -- Caffe2: CUDA detected: 11.7
  -- Caffe2: CUDA nvcc is: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/nvcc
  -- Caffe2: CUDA toolkit directory: /cfs/user/burkliu/dev/anaconda3/envs/k2_m
  CMake Error at /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:88 (message):
    Caffe2: Couldn't determine version from header: Change Dir:
    /tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp
  
  
  
  
    Run Build Command(s):/cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/make -f
    Makefile cmTC_e257c/fast &&
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/make -f
    CMakeFiles/cmTC_e257c.dir/build.make CMakeFiles/cmTC_e257c.dir/build
  
    make[1]: Entering directory
    '/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp'
  
  
    Building CXX object CMakeFiles/cmTC_e257c.dir/detect_cuda_version.cc.o
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/c++
    -I/cfs/user/burkliu/dev/anaconda3/envs/k2_m/include -std=c++14 -o
    CMakeFiles/cmTC_e257c.dir/detect_cuda_version.cc.o -c
    /tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/detect_cuda_version.cc
  
  
    Linking CXX executable cmTC_e257c
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/cmake -E cmake_link_script
    CMakeFiles/cmTC_e257c.dir/link.txt --verbose=1
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/c++
    CMakeFiles/cmTC_e257c.dir/detect_cuda_version.cc.o -o cmTC_e257c
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/libcudart.so
  
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/../lib/gcc/x86_64-conda-linux-gnu/11.3.0/../../../../x86_64-conda-linux-gnu/bin/ld:
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/libcudart.so: undefined
    reference to `memcpy@GLIBC_2.14'
  
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/../lib/gcc/x86_64-conda-linux-gnu/11.3.0/../../../../x86_64-conda-linux-gnu/bin/ld:
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/libcudart.so: undefined
    reference to `clock_gettime@GLIBC_2.17'
  
    collect2: error: ld returned 1 exit status
  
    make[1]: *** [CMakeFiles/cmTC_e257c.dir/build.make:100: cmTC_e257c] Error 1
  
    make[1]: Leaving directory
    '/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp'
  
  
    make: *** [Makefile:127: cmTC_e257c/fast] Error 2
  
  
  
  Call Stack (most recent call first):
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:88 (include)
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
    cmake/torch.cmake:13 (find_package)
    CMakeLists.txt:48 (include)
  
  
  -- Configuring incomplete, errors occurred!
  See also "/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeOutput.log".
  See also "/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeError.log".
  make: *** No rule to make target '_kaldifeat'.  Stop.
  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/setup.py", line 32, in <module>
      setuptools.setup(
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/__init__.py", line 87, in setup
      return distutils.core.setup(**attrs)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 185, in setup
      return run_commands(dist)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
      dist.run_commands()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 973, in run_commands
      self.run_command(cmd)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/wheel/bdist_wheel.py", line 299, in run
      self.run_command('build')
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
      self.distribution.run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/command/build.py", line 24, in run
      super().run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/command/build.py", line 132, in run
      self.run_command(cmd_name)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
      self.distribution.run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 79, in run
      _build_ext.run(self)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 346, in run
      self.build_extensions()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 466, in build_extensions
      self._build_extensions_serial()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 492, in _build_extensions_serial
      self.build_extension(ext)
    File "/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/cmake/cmake_extension.py", line 110, in build_extension
      raise Exception(
  Exception:
  Build kaldifeat failed. Please check the error message.
  You can ask for help by creating an issue on GitHub.
  
  Click:
      https://github.com/csukuangfj/kaldifeat/issues/new
  
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for kaldifeat
Running setup.py clean for kaldifeat
Failed to build kaldifeat
Installing collected packages: kaldifeat
Running setup.py install for kaldifeat ... error
error: subprocess-exited-with-error

× Running setup.py install for kaldifeat did not run successfully.
│ exit code: 1
╰─> [188 lines of output]
running install
/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
running build
running build_py
creating build
creating build/lib.linux-x86_64-cpython-38
creating build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/offline_feature.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/online_feature.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/fbank.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/mfcc.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/plp.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/init.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/spectrogram.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
running build_ext
Setting PYTHON_EXECUTABLE to /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/python3.8
For fast compilation, run:
export KALDIFEAT_MAKE_ARGS="-j"; python setup.py install
build command is:

                  cd build/temp.linux-x86_64-cpython-38
  
                  cmake -DCMAKE_BUILD_TYPE=Release -DPYTHON_EXECUTABLE=/cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/python3.8 /tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783
  
  
                  make  _kaldifeat
  
  -- The C compiler identification is GNU 11.3.0
  -- The CXX compiler identification is GNU 11.3.0
  -- Detecting C compiler ABI info
  -- Detecting C compiler ABI info - done
  -- Check for working C compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/cc - skipped
  -- Detecting C compile features
  -- Detecting C compile features - done
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Check for working CXX compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/c++ - skipped
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  -- C++ Standard version: 14
  -- Downloading pybind11
  -- pybind11 is downloaded to /tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/_deps/pybind11-src
  -- pybind11 v2.9.2
  -- Found PythonInterp: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/python3.8 (found version "3.8.13")
  -- Found PythonLibs: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/libpython3.8.so
  -- Performing Test HAS_FLTO
  -- Performing Test HAS_FLTO - Success
  -- Python executable: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/python3.8
  -- Looking for pthread.h
  -- Looking for pthread.h - found
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
  -- Looking for pthread_create in pthreads
  -- Looking for pthread_create in pthreads - not found
  -- Looking for pthread_create in pthread
  -- Looking for pthread_create in pthread - found
  -- Found Threads: TRUE
  -- Found CUDA: /cfs/user/burkliu/dev/anaconda3/envs/k2_m (found version "11.7")
  -- The CUDA compiler identification is NVIDIA 11.7.64
  -- Detecting CUDA compiler ABI info
  -- Detecting CUDA compiler ABI info - done
  -- Check for working CUDA compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/nvcc - skipped
  -- Detecting CUDA compile features
  -- Detecting CUDA compile features - done
  -- Caffe2: CUDA detected: 11.7
  -- Caffe2: CUDA nvcc is: /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/nvcc
  -- Caffe2: CUDA toolkit directory: /cfs/user/burkliu/dev/anaconda3/envs/k2_m
  CMake Error at /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:88 (message):
    Caffe2: Couldn't determine version from header: Change Dir:
    /tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp
  
  
  
  
    Run Build Command(s):/cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/make -f
    Makefile cmTC_a8777/fast &&
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/make -f
    CMakeFiles/cmTC_a8777.dir/build.make CMakeFiles/cmTC_a8777.dir/build
  
    make[1]: Entering directory
    '/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp'
  
  
    Building CXX object CMakeFiles/cmTC_a8777.dir/detect_cuda_version.cc.o
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/c++
    -I/cfs/user/burkliu/dev/anaconda3/envs/k2_m/include -std=c++14 -o
    CMakeFiles/cmTC_a8777.dir/detect_cuda_version.cc.o -c
    /tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/detect_cuda_version.cc
  
  
    Linking CXX executable cmTC_a8777
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/cmake -E cmake_link_script
    CMakeFiles/cmTC_a8777.dir/link.txt --verbose=1
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/c++
    CMakeFiles/cmTC_a8777.dir/detect_cuda_version.cc.o -o cmTC_a8777
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/libcudart.so
  
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/../lib/gcc/x86_64-conda-linux-gnu/11.3.0/../../../../x86_64-conda-linux-gnu/bin/ld:
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/libcudart.so: undefined
    reference to `memcpy@GLIBC_2.14'
  
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/bin/../lib/gcc/x86_64-conda-linux-gnu/11.3.0/../../../../x86_64-conda-linux-gnu/bin/ld:
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/libcudart.so: undefined
    reference to `clock_gettime@GLIBC_2.17'
  
    collect2: error: ld returned 1 exit status
  
    make[1]: *** [CMakeFiles/cmTC_a8777.dir/build.make:100: cmTC_a8777] Error 1
  
    make[1]: Leaving directory
    '/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp'
  
  
    make: *** [Makefile:127: cmTC_a8777/fast] Error 2
  
  
  
  Call Stack (most recent call first):
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:88 (include)
    /cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
    cmake/torch.cmake:13 (find_package)
    CMakeLists.txt:48 (include)
  
  
  -- Configuring incomplete, errors occurred!
  See also "/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeOutput.log".
  See also "/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeError.log".
  make: *** No rule to make target '_kaldifeat'.  Stop.
  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/setup.py", line 32, in <module>
      setuptools.setup(
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/__init__.py", line 87, in setup
      return distutils.core.setup(**attrs)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 185, in setup
      return run_commands(dist)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
      dist.run_commands()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 973, in run_commands
      self.run_command(cmd)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/command/install.py", line 68, in run
      return orig.install.run(self)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/command/install.py", line 698, in run
      self.run_command('build')
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
      self.distribution.run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/command/build.py", line 24, in run
      super().run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/command/build.py", line 132, in run
      self.run_command(cmd_name)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
      self.distribution.run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 79, in run
      _build_ext.run(self)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 346, in run
      self.build_extensions()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 466, in build_extensions
      self._build_extensions_serial()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_m/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 492, in _build_extensions_serial
      self.build_extension(ext)
    File "/tmp/pip-install-wu0b8kwx/kaldifeat_ce98eebe94604b818d6f906974358783/cmake/cmake_extension.py", line 110, in build_extension
      raise Exception(
  Exception:
  Build kaldifeat failed. Please check the error message.
  You can ask for help by creating an issue on GitHub.
  
  Click:
      https://github.com/csukuangfj/kaldifeat/issues/new
  
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure

× Encountered error while trying to install package.
╰─> kaldifeat

note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
@boji123
Copy link
Author

boji123 commented Aug 2, 2022

my conda env
conda install gcc=11 gxx=11 python=3.8 git git-lfs make cmake cuda cudnn -c conda-forge -c nvidia
conda install pytorch torchvision torchaudio cudatoolkit=11.6 -c pytorch -c conda-forge

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

error occurs when I call pip install kaldifeat

@csukuangfj
Copy link
Owner

csukuangfj commented Aug 2, 2022 •
edited

Can you use nvcc to compile and run the following file?
(You can create a new file, e.g., hello.cu, from it.)

#include <cuda.h>
#include <cstdio>
int main() {
  printf("%d.%d", CUDA_VERSION / 1000, (CUDA_VERSION / 10) % 100);
  return 0;
}

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

nvcc -arch sm_86 test.cu -o test && ./test
11.7

@boji123
Copy link
Author

boji123 commented Aug 2, 2022 •
edited

I tried conda install gcc=11 gxx=11 python=3.8 git git-lfs make cmake cuda=11.6 cudnn -c conda-forge -c nvidia
use cuda=11.6 fail too

@csukuangfj
Copy link
Owner

nvcc -arch sm_86 test.cu -o test && ./test 11.7

It shows 11.7, but you said you have installed cuda 11.6.

Please recheck your cudatoolkit.

Please don't use

conda install gcc=11 gxx=11 python=3.8 git git-lfs make cmake cuda cudnn -c conda-forge -c nvidia

without specifying which cuda version you want to use.

@csukuangfj
Copy link
Owner

csukuangfj commented Aug 2, 2022 •
edited

I suggest that you create a new environment to install kaldifeat as your current environment is possibly corrupted.

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

I create a new env using
conda install gcc=11 gxx=11 python=3.8 git git-lfs make cmake cuda -c conda-forge -c nvidia/label/cuda-11.6.2
conda install pytorch torchvision torchaudio cudatoolkit=11.6 -c pytorch -c conda-forge
but still fail

pip install kaldifeat
Looking in indexes: http://mirrors.cloud.tencent.com/pypi/simple
Collecting kaldifeat
Downloading http://mirrors.cloud.tencent.com/pypi/packages/2d/7b/0a5c9254de6a62cdca7bea829bd8d5d646e18508d34f9214f048ee003fed/kaldifeat-1.17.tar.gz (477 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 477.7/477.7 kB 903.7 kB/s eta 0:00:00
Preparing metadata (setup.py) ... done
Building wheels for collected packages: kaldifeat
Building wheel for kaldifeat (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [184 lines of output]
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-cpython-38
creating build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/offline_feature.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/online_feature.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/fbank.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/mfcc.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/plp.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/init.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/spectrogram.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
running build_ext
Setting PYTHON_EXECUTABLE to /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/python3.8
For fast compilation, run:
export KALDIFEAT_MAKE_ARGS="-j"; python setup.py install
build command is:

                  cd build/temp.linux-x86_64-cpython-38
  
                  cmake -DCMAKE_BUILD_TYPE=Release -DPYTHON_EXECUTABLE=/cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/python3.8 /tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b
  
  
                  make  _kaldifeat
  
  -- The C compiler identification is GNU 11.3.0
  -- The CXX compiler identification is GNU 11.3.0
  -- Detecting C compiler ABI info
  -- Detecting C compiler ABI info - done
  -- Check for working C compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/cc - skipped
  -- Detecting C compile features
  -- Detecting C compile features - done
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Check for working CXX compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/c++ - skipped
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  -- C++ Standard version: 14
  -- Downloading pybind11
  -- pybind11 is downloaded to /tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/_deps/pybind11-src
  -- pybind11 v2.9.2
  -- Found PythonInterp: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/python3.8 (found version "3.8.13")
  -- Found PythonLibs: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libpython3.8.so
  -- Performing Test HAS_FLTO
  -- Performing Test HAS_FLTO - Success
  -- Python executable: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/python3.8
  -- Looking for pthread.h
  -- Looking for pthread.h - found
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
  -- Looking for pthread_create in pthreads
  -- Looking for pthread_create in pthreads - not found
  -- Looking for pthread_create in pthread
  -- Looking for pthread_create in pthread - found
  -- Found Threads: TRUE
  -- Found CUDA: /cfs/user/burkliu/dev/anaconda3/envs/k2_p (found version "11.6")
  -- The CUDA compiler identification is NVIDIA 11.6.124
  -- Detecting CUDA compiler ABI info
  -- Detecting CUDA compiler ABI info - done
  -- Check for working CUDA compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/nvcc - skipped
  -- Detecting CUDA compile features
  -- Detecting CUDA compile features - done
  -- Caffe2: CUDA detected: 11.6
  -- Caffe2: CUDA nvcc is: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/nvcc
  -- Caffe2: CUDA toolkit directory: /cfs/user/burkliu/dev/anaconda3/envs/k2_p
  CMake Error at /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:88 (message):
    Caffe2: Couldn't determine version from header: Change Dir:
    /tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp
  
  
  
  
    Run Build Command(s):/cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/make -f
    Makefile cmTC_8ccda/fast &&
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/make -f
    CMakeFiles/cmTC_8ccda.dir/build.make CMakeFiles/cmTC_8ccda.dir/build
  
    make[1]: Entering directory
    '/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp'
  
  
    Building CXX object CMakeFiles/cmTC_8ccda.dir/detect_cuda_version.cc.o
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/c++
    -I/cfs/user/burkliu/dev/anaconda3/envs/k2_p/include -std=c++14 -o
    CMakeFiles/cmTC_8ccda.dir/detect_cuda_version.cc.o -c
    /tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/detect_cuda_version.cc
  
  
    Linking CXX executable cmTC_8ccda
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/cmake -E cmake_link_script
    CMakeFiles/cmTC_8ccda.dir/link.txt --verbose=1
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/c++
    CMakeFiles/cmTC_8ccda.dir/detect_cuda_version.cc.o -o cmTC_8ccda
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so
  
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/../lib/gcc/x86_64-conda-linux-gnu/11.3.0/../../../../x86_64-conda-linux-gnu/bin/ld:
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so: undefined
    reference to `memcpy@GLIBC_2.14'
  
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/../lib/gcc/x86_64-conda-linux-gnu/11.3.0/../../../../x86_64-conda-linux-gnu/bin/ld:
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so: undefined
    reference to `clock_gettime@GLIBC_2.17'
  
    collect2: error: ld returned 1 exit status
  
    make[1]: *** [CMakeFiles/cmTC_8ccda.dir/build.make:100: cmTC_8ccda] Error 1
  
    make[1]: Leaving directory
    '/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp'
  
  
    make: *** [Makefile:127: cmTC_8ccda/fast] Error 2
  
  
  
  Call Stack (most recent call first):
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:88 (include)
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
    cmake/torch.cmake:13 (find_package)
    CMakeLists.txt:48 (include)
  
  
  -- Configuring incomplete, errors occurred!
  See also "/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeOutput.log".
  See also "/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeError.log".
  make: *** No rule to make target '_kaldifeat'.  Stop.
  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/setup.py", line 32, in <module>
      setuptools.setup(
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/__init__.py", line 87, in setup
      return distutils.core.setup(**attrs)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 185, in setup
      return run_commands(dist)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
      dist.run_commands()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 973, in run_commands
      self.run_command(cmd)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/wheel/bdist_wheel.py", line 299, in run
      self.run_command('build')
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
      self.distribution.run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/command/build.py", line 24, in run
      super().run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/command/build.py", line 132, in run
      self.run_command(cmd_name)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
      self.distribution.run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 79, in run
      _build_ext.run(self)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 346, in run
      self.build_extensions()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 466, in build_extensions
      self._build_extensions_serial()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 492, in _build_extensions_serial
      self.build_extension(ext)
    File "/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/cmake/cmake_extension.py", line 110, in build_extension
      raise Exception(
  Exception:
  Build kaldifeat failed. Please check the error message.
  You can ask for help by creating an issue on GitHub.
  
  Click:
      https://github.com/csukuangfj/kaldifeat/issues/new
  
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for kaldifeat
Running setup.py clean for kaldifeat
Failed to build kaldifeat
Installing collected packages: kaldifeat
Running setup.py install for kaldifeat ... error
error: subprocess-exited-with-error

× Running setup.py install for kaldifeat did not run successfully.
│ exit code: 1
╰─> [188 lines of output]
running install
/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
running build
running build_py
creating build
creating build/lib.linux-x86_64-cpython-38
creating build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/offline_feature.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/online_feature.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/fbank.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/mfcc.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/plp.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/init.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
copying kaldifeat/python/kaldifeat/spectrogram.py -> build/lib.linux-x86_64-cpython-38/kaldifeat
running build_ext
Setting PYTHON_EXECUTABLE to /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/python3.8
For fast compilation, run:
export KALDIFEAT_MAKE_ARGS="-j"; python setup.py install
build command is:

                  cd build/temp.linux-x86_64-cpython-38
  
                  cmake -DCMAKE_BUILD_TYPE=Release -DPYTHON_EXECUTABLE=/cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/python3.8 /tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b
  
  
                  make  _kaldifeat
  
  -- The C compiler identification is GNU 11.3.0
  -- The CXX compiler identification is GNU 11.3.0
  -- Detecting C compiler ABI info
  -- Detecting C compiler ABI info - done
  -- Check for working C compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/cc - skipped
  -- Detecting C compile features
  -- Detecting C compile features - done
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Check for working CXX compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/c++ - skipped
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  -- C++ Standard version: 14
  -- Downloading pybind11
  -- pybind11 is downloaded to /tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/_deps/pybind11-src
  -- pybind11 v2.9.2
  -- Found PythonInterp: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/python3.8 (found version "3.8.13")
  -- Found PythonLibs: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libpython3.8.so
  -- Performing Test HAS_FLTO
  -- Performing Test HAS_FLTO - Success
  -- Python executable: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/python3.8
  -- Looking for pthread.h
  -- Looking for pthread.h - found
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
  -- Looking for pthread_create in pthreads
  -- Looking for pthread_create in pthreads - not found
  -- Looking for pthread_create in pthread
  -- Looking for pthread_create in pthread - found
  -- Found Threads: TRUE
  -- Found CUDA: /cfs/user/burkliu/dev/anaconda3/envs/k2_p (found version "11.6")
  -- The CUDA compiler identification is NVIDIA 11.6.124
  -- Detecting CUDA compiler ABI info
  -- Detecting CUDA compiler ABI info - done
  -- Check for working CUDA compiler: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/nvcc - skipped
  -- Detecting CUDA compile features
  -- Detecting CUDA compile features - done
  -- Caffe2: CUDA detected: 11.6
  -- Caffe2: CUDA nvcc is: /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/nvcc
  -- Caffe2: CUDA toolkit directory: /cfs/user/burkliu/dev/anaconda3/envs/k2_p
  CMake Error at /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:88 (message):
    Caffe2: Couldn't determine version from header: Change Dir:
    /tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp
  
  
  
  
    Run Build Command(s):/cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/make -f
    Makefile cmTC_66354/fast &&
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/make -f
    CMakeFiles/cmTC_66354.dir/build.make CMakeFiles/cmTC_66354.dir/build
  
    make[1]: Entering directory
    '/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp'
  
  
    Building CXX object CMakeFiles/cmTC_66354.dir/detect_cuda_version.cc.o
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/c++
    -I/cfs/user/burkliu/dev/anaconda3/envs/k2_p/include -std=c++14 -o
    CMakeFiles/cmTC_66354.dir/detect_cuda_version.cc.o -c
    /tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/detect_cuda_version.cc
  
  
    Linking CXX executable cmTC_66354
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/cmake -E cmake_link_script
    CMakeFiles/cmTC_66354.dir/link.txt --verbose=1
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/c++
    CMakeFiles/cmTC_66354.dir/detect_cuda_version.cc.o -o cmTC_66354
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so
  
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/../lib/gcc/x86_64-conda-linux-gnu/11.3.0/../../../../x86_64-conda-linux-gnu/bin/ld:
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so: undefined
    reference to `memcpy@GLIBC_2.14'
  
  
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/bin/../lib/gcc/x86_64-conda-linux-gnu/11.3.0/../../../../x86_64-conda-linux-gnu/bin/ld:
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so: undefined
    reference to `clock_gettime@GLIBC_2.17'
  
    collect2: error: ld returned 1 exit status
  
    make[1]: *** [CMakeFiles/cmTC_66354.dir/build.make:100: cmTC_66354] Error 1
  
    make[1]: Leaving directory
    '/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeTmp'
  
  
    make: *** [Makefile:127: cmTC_66354/fast] Error 2
  
  
  
  Call Stack (most recent call first):
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:88 (include)
    /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
    cmake/torch.cmake:13 (find_package)
    CMakeLists.txt:48 (include)
  
  
  -- Configuring incomplete, errors occurred!
  See also "/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeOutput.log".
  See also "/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/build/temp.linux-x86_64-cpython-38/CMakeFiles/CMakeError.log".
  make: *** No rule to make target '_kaldifeat'.  Stop.
  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/setup.py", line 32, in <module>
      setuptools.setup(
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/__init__.py", line 87, in setup
      return distutils.core.setup(**attrs)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 185, in setup
      return run_commands(dist)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
      dist.run_commands()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 973, in run_commands
      self.run_command(cmd)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/command/install.py", line 68, in run
      return orig.install.run(self)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/command/install.py", line 698, in run
      self.run_command('build')
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
      self.distribution.run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/command/build.py", line 24, in run
      super().run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/command/build.py", line 132, in run
      self.run_command(cmd_name)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
      self.distribution.run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
      super().run_command(command)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 992, in run_command
      cmd_obj.run()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 79, in run
      _build_ext.run(self)
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 346, in run
      self.build_extensions()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 466, in build_extensions
      self._build_extensions_serial()
    File "/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 492, in _build_extensions_serial
      self.build_extension(ext)
    File "/tmp/pip-install-rr5b5kka/kaldifeat_3c0571cf06ac4095a52d7d4385c6e94b/cmake/cmake_extension.py", line 110, in build_extension
      raise Exception(
  Exception:
  Build kaldifeat failed. Please check the error message.
  You can ask for help by creating an issue on GitHub.
  
  Click:
      https://github.com/csukuangfj/kaldifeat/issues/new
  
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure

× Encountered error while trying to install package.
╰─> kaldifeat

note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

nvcc -arch sm_86 test.cu -o test && ./test
11.6

@csukuangfj
Copy link
Owner

Could you create the following file, e.g., activate-cuda-11.6.sh and run

source activate-cuda-11.6.sh

before you run pip install --verbose kaldifeat?

#!/usr/bin/env bash

export CUDA_HOME=/cfs/user/burkliu/dev/anaconda3/envs/k2_p
export PATH=$CUDA_HOME/bin:$PATH
export LD_LIBRARY_PATH=$CUDA_HOME/lib64:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH=$CUDA_HOME/lib:$LD_LIBRARY_PATH

export CUDA_TOOLKIT_ROOT_DIR=$CUDA_HOME
export CUDA_TOOLKIT_ROOT=$CUDA_HOME
export CUDA_BIN_PATH=$CUDA_HOME
export CUDA_PATH=$CUDA_HOME
export CUDA_INC_PATH=$CUDA_HOME/targets/x86_64-linux

@csukuangfj
Copy link
Owner

nvcc -arch sm_86 test.cu -o test && ./test 11.6

I think I find the reason.
CMake is saving it as a .cc file and tries to compile it with g++.

But you have not set up cudatoolkit correctly, so it cannot find the directory where cuda.h locates.

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

fail again after source activate-cuda-11.6.sh
same error, missing mem and clock glibc

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

I find cuda.h in /cfs/user/burkliu/dev/anaconda3/envs/k2_p/include

@csukuangfj
Copy link
Owner

Are you able to save the following content to test.cc and compile it with

g++ test.cc -o test
./test
#include <cuda.h>
#include <cstdio>
int main() {
  printf("%d.%d", CUDA_VERSION / 1000, (CUDA_VERSION / 10) % 100);
  return 0;
}

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

g++ test.cc -o test && ./test
test.cc:1:10: fatal error: cuda.h: No such file or directory
1 | #include <cuda.h>
| ^~~~~~~~
compilation terminated.

@csukuangfj
Copy link
Owner

I find cuda.h in /cfs/user/burkliu/dev/anaconda3/envs/k2_p/include

In that case, could you change

export CUDA_INC_PATH=$CUDA_HOME/targets/x86_64-linux

to

export CUDA_INC_PATH=$CUDA_HOME

For test.cc:1:10: fatal error: cuda.h: No such file or directory

Can you use

g++ -I $CUDA_HOME/include test.cc -o test && ./test

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

success as u said

g++ -I $CUDA_HOME/include test.cc -o test && ./test
11.6

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

but export CUDA_INC_PATH=$CUDA_HOME fail to install kaldifeat, same error

@csukuangfj
Copy link
Owner

Are you able to run

/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so
g++ -I $CUDA_HOME/include test.cc /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so -o test && ./test
ldd /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

g++ -I $CUDA_HOME/include test.cc /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so -o test && ./test
test.cc:1:10: fatal error: cuda.h: No such file or directory
1 | #include <cuda.h>
| ^~~~~~~~
compilation terminated.

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

I think I found something interesting

ldd /cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so
linux-vdso.so.1 (0x00007ffc8bc71000)
/$LIB/libonion.so => /lib/x86_64-linux-gnu/libonion.so (0x00007f9c1ea5c000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f9c1e2a3000)
/lib64/ld-linux-x86-64.so.2 (0x00007f9c1e93c000)
libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f9c1e09f000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f9c1de80000)
librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f9c1dc78000)

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

/cfs/user/burkliu/dev/anaconda3/envs/k2_p/lib/libcudart.so
Segmentation fault (core dumped)

@csukuangfj
Copy link
Owner

Your system libc version may be too low and cannot work with cuda 11.6

You can check whether your conda env has provided libc.so.6. If yes, you can set the environment variable

export LIBRARY_PATH=/path/to/the/dir:$LIBRARY_PATH

export LD_LIBRARY_PATH=/path/to/the/dir:$LD_LIBRARY_PATH

Segmentation fault (core dumped)

Yes, that is expected. You cannot run it.

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

/lib/x86_64-linux-gnu$ ll | grep libc.so
lrwxrwxrwx 1 root root 12 May 3 18:19 libc.so.6 -> libc-2.27.so

seems it's high enough

@boji123
Copy link
Author

boji123 commented Aug 2, 2022

success with conda install kaldifeat -c kaldifeat

but compile still fail

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@csukuangfj @boji123