Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support torchtext natively in DJL pytorch engine #1394

Open
jiyuanq opened this issue Nov 29, 2021 · 1 comment
Open

Support torchtext natively in DJL pytorch engine #1394

jiyuanq opened this issue Nov 29, 2021 · 1 comment
Labels
enhancement New feature or request

Comments

@jiyuanq
Copy link
Contributor

jiyuanq commented Nov 29, 2021

Description

Currently pytorch models using torchtext modules cannot be loaded with DJL pytorch engine

I tried loading the _torchtext.so from python site packages in DJL with "PYTORCH_EXTRA_LIBRARY_PATH", but it doesn't seem to work either

Caused by: ai.djl.engine.EngineException: Failed to load PyTorch native library
Caused by: java.lang.UnsatisfiedLinkError: /usr/local/lib/python3.8/dist-packages/torchtext/_torchtext.so: libtorch_python.so: cannot open shared object file: No such file or directory

It looks like the _torchtext.so built for python is not compatible with DJL.

It would be great if DJL provides it as part of its pytorch native library distribution
@jiyuanq jiyuanq added the enhancement New feature or request label Nov 29, 2021
@frankfliu
Copy link
Contributor

This is currently blocked by: pytorch/vision#2692

@frankfliu frankfliu mentioned this issue Jan 7, 2022
Merged
@frankfliu frankfliu mentioned this issue Apr 8, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@frankfliu @jiyuanq