Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conda installations simply don't work. Libtbb dependency issues. #30

Open
snarasimhan1997 opened this issue Jan 3, 2023 · 1 comment

Comments

@snarasimhan1997
Copy link

Installing any mlio version using the recommended conda method does not seem to work. I am not able to import mlio without running into Symbol not found errors in dylib files related to libtbb. I think this is because the conda build isn't properly specifying the version of libtbb and other c++ dependencies that should be used. I can see that mlio builds all its own thirdparty cpp dependencies inside the thirdparty/build folder. Furthermore, Inside Sagemaker scikit container Dockerfile, after building mlio from scratch, theses libtbb binaries in this are later copied to /usr/local/lib to be used later. If my understanding is correct, buiding ml-io from source and copying these dependencies to /usr/local/lib should work.

The exact error I am facing is in this issue.. It has also been reported in past issues, here and here. Can someone please help me solve this?

@snarasimhan1997
Copy link
Author

How to reproduce the error:

conda create --name myenv python=3.7
conda activate myenv
conda install -c mlio -c conda-forge mlio-py
python -c 'import mlio'

We get the following error:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/usr/local/anaconda3/envs/myenv2/lib/python3.7/site-packages/mlio/__init__.py", line 18, in <module>
    import mlio._core
ImportError: dlopen(/usr/local/anaconda3/envs/myenv2/lib/python3.7/site-packages/mlio/_core.cpython-37m-darwin.so, 0x0002): Library not loaded: '@rpath/libtbb.dylib'
  Referenced from: '/usr/local/anaconda3/envs/myenv2/lib/libmlio.0.6.0.dylib'
  Reason: tried: '/usr/local/anaconda3/envs/myenv2/lib/libtbb.dylib' (no such file), '/usr/local/anaconda3/envs/myenv2/lib/libtbb.dylib' (no such file), '/usr/local/anaconda3/envs/myenv2/lib/libtbb.dylib' (no such file), '/usr/local/anaconda3/envs/myenv2/lib/python3.7/site-packages/mlio/../../../libtbb.dylib' (no such file), '/usr/local/anaconda3/envs/myenv2/lib/libtbb.dylib' (no such file), '/usr/local/anaconda3/envs/myenv2/lib/python3.7/site-packages/mlio/../../../libtbb.dylib' (no such file), '/usr/local/anaconda3/envs/myenv2/lib/libtbb.dylib' (no such file), '/usr/local/anaconda3/envs/myenv2/bin/../lib/libtbb.dylib' (no such file), '/usr/local/anaconda3/envs/myenv2/lib/libtbb.dylib' (no such file), '/usr/local/anaconda3/envs/myenv2/bin/../lib/libtbb.dylib' (no such file), '/usr/local/lib/libtbb.dylib' (no such file), '/usr/lib/libtbb.dylib' (no such file)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant