Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

already passed the verify_install.py but cant pass the app.py "ImportError: DLL load failed while importing tensorrt: 找不到指定的模块。" #63

Open
beeinwind opened this issue May 27, 2024 · 2 comments
Assignees

Comments

@beeinwind
Copy link

(ChatRTX) E:\chat1\trt-llm-rag-windows>python app.py
E:\chat1\ChatRTX\lib\site-packages\transformers\utils\generic.py:441: UserWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils.pytree.register_pytree_node instead.
torch_pytree.register_pytree_node(
Traceback (most recent call last):
File "E:\chat1\trt-llm-rag-windows\app.py", line 31, in
from trt_llama_api import TrtLlmAPI
File "E:\chat1\trt-llm-rag-windows\trt_llama_api.py", line 42, in
from utils import (DEFAULT_HF_MODEL_DIRS, DEFAULT_PROMPT_TEMPLATES,
File "E:\chat1\trt-llm-rag-windows\utils.py", line 22, in
from tensorrt_llm.builder import get_engine_version
File "E:\chat1\ChatRTX\lib\site-packages\tensorrt_llm_init
.py", line 32, in
import tensorrt_llm.functional as functional
File "E:\chat1\ChatRTX\lib\site-packages\tensorrt_llm\functional.py", line 26, in
import tensorrt as trt
File "E:\chat1\ChatRTX\lib\site-packages\tensorrt_init
.py", line 18, in
from tensorrt_bindings import *
File "E:\chat1\ChatRTX\lib\site-packages\tensorrt_bindings_init.py", line 71, in
from .tensorrt import *
ImportError: DLL load failed while importing tensorrt: 找不到指定的模块。

@anujj
Copy link
Collaborator

anujj commented May 29, 2024

@beeinwind: can you please share the pip freeze output, i wanted to check if the trt-llm in installed correctly

@anujj
Copy link
Collaborator

anujj commented May 30, 2024

@beeinwind Also did you install the Microsoft MIP as mentioned in the readme file ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants