undefined symbol when importing torchaudio with pytorch #62

ccoulombe · 2018-10-03T16:00:54Z

Hi,
When importing torchaudio with pytorch 0.4.1 I get an undefined symbol. It does however work with v0.4.0. audio version: 7314b36

Successfully installed numpy-1.15.0 torch-cpu-0.4.1 torchaudio-0.1
(test_venv) [~]$ python -c "import torchaudio;"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "test_venv/lib/python3.6/site-packages/torchaudio/__init__.py", line 4, in <module>
    import _torch_sox
ImportError: test_venv/lib/python3.6/site-packages/_torch_sox.cpython-36m-x86_64-linux-gnu.so: undefined symbol: _ZN2at5ErrorC1ENS_14SourceLocationESs

Thanks

The text was updated successfully, but these errors were encountered:

sh0416 · 2018-10-06T07:25:44Z

I also encounter same problem.
The reason why the problem occur is virtual environment.
I use base environment and the problem doesn't occur even if the version is 0.4.1

XilunWu · 2018-10-30T18:01:08Z

Same problem. When I use virtual environment in conda, it occurs while it doesn't occur in the base environment.

ghost · 2018-11-08T17:40:29Z

How to install the package into existing virtual environment with Anaconda3?
I can not change to use the 'base' environment, because the Conda environment have installed so many packages

ghost · 2018-11-08T17:46:04Z

To be Use the 'base' environment may cause some unkown errors,how to fix this bug?
ox.cpython-37m-x86_64-linux-gnu.so
linux-vdso.so.1 (0x00007ffefa331000)
libsox.so.3 => /usr/lib/x86_64-linux-gnu/libsox.so.3 (0x00007f15ce295000)
libstdc++.so.6 => /home//.conda/envs/PyTorch/lib/libstdc++.so.6 (0x00007f15ce5c8000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f15cdef7000)
libgcc_s.so.1 => /home//.conda/envs/PyTorch/lib/libgcc_s.so.1 (0x00007f15ce5b3000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f15cdcd8000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f15cd8e7000)
libltdl.so.7 => /usr/lib/x86_64-linux-gnu/libltdl.so.7 (0x00007f15cd6dd000)
libpng16.so.16 => /usr/lib/x86_64-linux-gnu/libpng16.so.16 (0x00007f15cd4ab000)
libz.so.1 => /home//.conda/envs/PyTorch/lib/libz.so.1 (0x00007f15cd294000)
libmagic.so.1 => /usr/lib/x86_64-linux-gnu/libmagic.so.1 (0x00007f15cd072000)
libgsm.so.1 => /usr/lib/x86_64-linux-gnu/libgsm.so.1 (0x00007f15cce65000)
libgomp.so.1 => /home//.conda/envs/PyTorch/lib/libgomp.so.1 (0x00007f15ce58b000)
Is this problem caused by source bug ?or other reason ?
how to build the packages?
or where to download the rebuild package with pip?

ccoulombe · 2019-02-11T16:34:33Z

With torch 1.0.0, I monkey patched this issue. It is caused by an issue in torch where is does not detect correctly the ABI of the wheel and forces to add -D_GLIBCXX_USE_CXX11_ABI=0 when it was compiled with -D_GLIBCXX_USE_CXX11_ABI=1. CFLAGS are not heard as the flag is forced at the end and the right most argument is the one heard by the compiler.

Make sure torchaudio is compiled with -D_GLIBCXX_USE_CXX11_ABI=1 if torch was build with CXX11_ABI.

Pytorch issue: pytorch/pytorch#16972

prajwalkr · 2019-02-24T17:15:18Z

@ccoulombe How do I make sure that torchaudio is compiled with that specific flag?

dav-ell · 2020-04-04T16:41:14Z

Interested in the solution to this problem as well.

jmlemercier · 2020-04-16T14:39:19Z

Really intersted in this solution as well: I have the same problem with Virtual AND Base environments. I use pytorch=1.4.0 and torchaudio=0.4.0

Tried installing torchaudio with pip and conda but I get the same issue.
Also tried to downgrade pytorch and torchaudio, but does not solve the issue, just adding new conflicts.

Would be very much appreciated if we re-opened this issue

[EDIT : solved this issue by downgrading to torchaudio=0.3.0 and torch=1.3.1]

ccoulombe · 2020-04-16T15:40:13Z

This issue was fixed in pytorch ~1.0.0 but I can re-trace the steps and provide more details when building from source. But maybe the wheels available on PyPI are built differently.

See : #62 (comment)

NumesSanguis · 2021-03-10T05:07:14Z

This issue occurred to me with pytorch=1.8.0, torchaudio=0.8.0 and cudatoolkit=11.1.1 through a conda environment.yaml install on Ubuntu 18.04:

OSError: /home/user/anaconda3/envs/some_env/lib/python3.8/site-packages/torchaudio/_torchaudio.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKSs

Full Traceback (CLICK ME)

---------------------------------------------------------------------------
OSError                                   Traceback (most recent call last)
<ipython-input-1-b60aa7932a25> in <module>
      6 from torchvision import transforms
      7 # import torchaudio
----> 8 from torchaudio import transforms as atransforms
      9 import pytorch_lightning as pl
     10 from pytorch_lightning import Trainer

~/anaconda3/envs/some_env/lib/python3.8/site-packages/torchaudio/__init__.py in <module>
----> 1 from . import extension  # noqa: F401
      2 from torchaudio._internal import module_utils as _mod_utils  # noqa: F401
      3 from torchaudio import (
      4     compliance,
      5     datasets,

~/anaconda3/envs/some_env/lib/python3.8/site-packages/torchaudio/extension/__init__.py in <module>
      3 )
      4 
----> 5 _init_extension()
      6 
      7 del _init_extension

~/anaconda3/envs/some_env/lib/python3.8/site-packages/torchaudio/extension/extension.py in _init_extension()
      9     ext = 'torchaudio._torchaudio'
     10     if _mod_utils.is_module_available(ext):
---> 11         _init_script_module(ext)
     12     else:
     13         warnings.warn('torchaudio C++ extension is not available.')

~/anaconda3/envs/some_env/lib/python3.8/site-packages/torchaudio/extension/extension.py in _init_script_module(module)
     16 def _init_script_module(module):
     17     path = importlib.util.find_spec(module).origin
---> 18     torch.classes.load_library(path)
     19     torch.ops.load_library(path)

~/anaconda3/envs/some_env/lib/python3.8/site-packages/torch/_classes.py in load_library(self, path)
     44             path (str): A path to a shared library to load.
     45         """
---> 46         torch.ops.load_library(path)
     47 
     48 # The classes "namespace"

~/anaconda3/envs/some_env/lib/python3.8/site-packages/torch/_ops.py in load_library(self, path)
    102             # static (global) initialization code in order to register custom
    103             # operators with the JIT.
--> 104             ctypes.CDLL(path)
    105         self.loaded_libraries.add(path)
    106 

~/anaconda3/envs/some_env/lib/python3.8/ctypes/__init__.py in __init__(self, name, mode, handle, use_errno, use_last_error, winmode)
    379 
    380         if handle is None:
--> 381             self._handle = _dlopen(self._name, mode)
    382         else:
    383             self._handle = handle

OSError: /home/user/anaconda3/envs/some_env/lib/python3.8/site-packages/torchaudio/_torchaudio.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKSs

mthrok · 2021-03-10T05:17:35Z

This issue occurred to me with pytorch=1.8.0, torchaudio=0.8.0 and cudatoolkit=11.1.1 through a conda environment.yaml install on Ubuntu 18.04:
OSError: /home/user/anaconda3/envs/some_env/lib/python3.8/site-packages/torchaudio/_torchaudio.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKSs
Full Traceback (CLICK ME)

@NumesSanguis The error means that your PyTorch C++ binary does not contain the function that torchaudio needs. It is likely version mismatch between torchaudio and pytorch.

NumesSanguis · 2021-03-10T05:43:19Z

@mthrok Thank you, this was indeed the issue. It was not the versions, but the channel of the conda package.

The release of PyTorch 1.8.0 was released together with the announcement of TorchAudio 0.8.0, so I would assume that these 2 versions would work together:

PyTorch 1.8.0: https://pytorch.org/blog/pytorch-1.8-released/
TorchAudio 0.8.0: https://pytorch.org/blog/pytorch-1.8-new-library-releases/#io-improvements

However, checking conda list:

pytorch                   1.8.0           cpu_py38he614459_0    conda-forge
torchaudio                0.8.0                      py38    pytorch

That shouldn't be the CPU version from conda-forge...

I also see an env inconsistency:

$ conda install pytorch -c pytorch
Collecting package metadata (current_repodata.json): done
Solving environment: - 
The environment is inconsistent, please check the package plan carefully
The following packages are causing the inconsistency:

  - pytorch/linux-64::torchaudio==0.8.0=py38
  - conda-forge/linux-64::cudatoolkit==11.1.1=h6406543_8
  - conda-forge/linux-64::pytorch==1.8.0=cpu_py38he614459_0
  - pytorch/linux-64::torchvision==0.9.0=py38_cu111
  - conda-forge/noarch::pytorch-lightning==1.1.8=pyhd8ed1ab_0
done

To solve it, I reversed the channel priority in my environment.yml:

channels:
  - defaults
  - pytorch
  - conda-forge

pytorch above conda-forge means that pytorch channel is prioritized (if my understanding is correct).

mthrok · 2021-03-10T13:18:40Z

@mthrok Thank you, this was indeed the issue. It was not the versions, but the channel of the conda package.

The release of PyTorch 1.8.0 was released together with the announcement of TorchAudio 0.8.0, so I would assume that these 2 versions would work together:

PyTorch 1.8.0: https://pytorch.org/blog/pytorch-1.8-released/

TorchAudio 0.8.0: https://pytorch.org/blog/pytorch-1.8-new-library-releases/#io-improvements

However, checking conda list:
pytorch                   1.8.0           cpu_py38he614459_0    conda-forge
torchaudio                0.8.0                      py38    pytorch
That shouldn't be the CPU version from conda-forge...

I also see an env inconsistency:
$ conda install pytorch -c pytorch
Collecting package metadata (current_repodata.json): done
Solving environment: - 
The environment is inconsistent, please check the package plan carefully
The following packages are causing the inconsistency:

  - pytorch/linux-64::torchaudio==0.8.0=py38
  - conda-forge/linux-64::cudatoolkit==11.1.1=h6406543_8
  - conda-forge/linux-64::pytorch==1.8.0=cpu_py38he614459_0
  - pytorch/linux-64::torchvision==0.9.0=py38_cu111
  - conda-forge/noarch::pytorch-lightning==1.1.8=pyhd8ed1ab_0
done
To solve it, I reversed the channel priority in my environment.yml:
channels:
  - defaults
  - pytorch
  - conda-forge
pytorch above conda-forge means that pytorch channel is prioritized (if my understanding is correct).

@NumesSanguis PyTorch 1.8.0 and torchaudio 0.8.0 work together. In fact PyTorch 1.8.0 is a strict requirement for torchaudio 0.8.0. For conda, pytorch channel is the official distribution channel, but conda-forge is not and we do not know how the packages in conda-forge are maintained. I guess in your case, things got mixed up. Glad to hear that now it's working.

thinker0v0 · 2022-06-24T04:37:56Z

I've same problem and couldn't find solution how to. I just changed kernel virenv from python 3.7 to python 3.6 then magically error's gone.

alireza-hariri · 2022-06-25T05:26:06Z

using -U option simply solved problem for me
pip install -U torch torchaudio --no-cache-dir

homink mentioned this issue Jan 8, 2019

importing model error jinserk/pytorch-asr#3

Closed

Ailuridae mentioned this issue Jan 17, 2019

Error running examples daniilidis-group/neural_renderer#35

Closed

ccoulombe closed this as completed Feb 11, 2019

ccoulombe changed the title ~~undefined symbol when importing torchaudio with pytorch 0.4.1~~ undefined symbol when importing torchaudio with pytorch Feb 11, 2019

ramithuh mentioned this issue Mar 3, 2023

_C.cpython-36m-x86_64-linux-gnu.so: undefined symbol: _ZN3c106Device8validateEv facebookresearch/maskrcnn-benchmark#891

Open

erkara mentioned this issue Mar 26, 2023

torchaudio error in GenericLoader and AttributeError: n_frames PIL TorchStudio/torchstudio#50

Open

pncnmnp mentioned this issue Apr 7, 2023

TTS ERROR pncnmnp/phoenix10.1#9

Closed

christoarif mentioned this issue Nov 3, 2023

torchaudio error: OSError: libtorch_cuda_cpp.so: cannot open shared object file: No such file or directory pytorch/pytorch#91186

Closed

This was referenced Nov 3, 2023

Problems when install on macOS rsxdalv/tts-generation-webui#196

Closed

Unable to launch WebUI rsxdalv/tts-generation-webui#200

Open

rsxdalv mentioned this issue Jan 14, 2024

Not even sure what's going wrong rsxdalv/tts-generation-webui#251

Closed

Qengineering mentioned this issue Apr 21, 2024

Error when importing torchaudio Qengineering/Jetson-Nano-Ubuntu-20-image#82

Closed

mike-rowley mentioned this issue May 22, 2024

(IMPORT FAILED): /mnt/wf/ComfyUI/custom_nodes/ComfyUI-SUPIR kijai/ComfyUI-SUPIR#119

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

undefined symbol when importing torchaudio with pytorch #62

undefined symbol when importing torchaudio with pytorch #62

ccoulombe commented Oct 3, 2018 •

edited

Loading

sh0416 commented Oct 6, 2018

XilunWu commented Oct 30, 2018

ghost commented Nov 8, 2018

ghost commented Nov 8, 2018

ccoulombe commented Feb 11, 2019 •

edited

Loading

prajwalkr commented Feb 24, 2019

dav-ell commented Apr 4, 2020

jmlemercier commented Apr 16, 2020 •

edited

Loading

ccoulombe commented Apr 16, 2020 •

edited

Loading

NumesSanguis commented Mar 10, 2021

mthrok commented Mar 10, 2021

NumesSanguis commented Mar 10, 2021

mthrok commented Mar 10, 2021 •

edited

Loading

thinker0v0 commented Jun 24, 2022

alireza-hariri commented Jun 25, 2022

undefined symbol when importing torchaudio with pytorch #62

undefined symbol when importing torchaudio with pytorch #62

Comments

ccoulombe commented Oct 3, 2018 • edited Loading

sh0416 commented Oct 6, 2018

XilunWu commented Oct 30, 2018

ghost commented Nov 8, 2018

ghost commented Nov 8, 2018

ccoulombe commented Feb 11, 2019 • edited Loading

prajwalkr commented Feb 24, 2019

dav-ell commented Apr 4, 2020

jmlemercier commented Apr 16, 2020 • edited Loading

ccoulombe commented Apr 16, 2020 • edited Loading

NumesSanguis commented Mar 10, 2021

mthrok commented Mar 10, 2021

NumesSanguis commented Mar 10, 2021

mthrok commented Mar 10, 2021 • edited Loading

thinker0v0 commented Jun 24, 2022

alireza-hariri commented Jun 25, 2022

ccoulombe commented Oct 3, 2018 •

edited

Loading

ccoulombe commented Feb 11, 2019 •

edited

Loading

jmlemercier commented Apr 16, 2020 •

edited

Loading

ccoulombe commented Apr 16, 2020 •

edited

Loading

mthrok commented Mar 10, 2021 •

edited

Loading