Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

构建容器后,运行API接口报错 #205

Closed
zhangwanshen opened this issue Nov 28, 2023 · 1 comment
Closed

构建容器后,运行API接口报错 #205

zhangwanshen opened this issue Nov 28, 2023 · 1 comment

Comments

@zhangwanshen
Copy link

root@d13118ccd081:/# uvicorn chatglm_cpp.langchain_api:app --host 0.0.0.0 --port 8000
2023-11-28 07:19:30,939 - langchain_api - INFO - model='chatglm-ggml.bin'
Traceback (most recent call last):
File "/usr/local/bin/uvicorn", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.8/dist-packages/click/core.py", line 1157, in call
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python3.8/dist-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.8/dist-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/uvicorn/main.py", line 416, in main
run(
File "/usr/local/lib/python3.8/dist-packages/uvicorn/main.py", line 587, in run
server.run()
File "/usr/local/lib/python3.8/dist-packages/uvicorn/server.py", line 61, in run
return asyncio.run(self.serve(sockets=sockets))
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
File "/usr/local/lib/python3.8/dist-packages/uvicorn/server.py", line 68, in serve
config.load()
File "/usr/local/lib/python3.8/dist-packages/uvicorn/config.py", line 467, in load
self.loaded_app = import_from_string(self.app)
File "/usr/local/lib/python3.8/dist-packages/uvicorn/importer.py", line 24, in import_from_string
raise exc from None
File "/usr/local/lib/python3.8/dist-packages/uvicorn/importer.py", line 21, in import_from_string
module = importlib.import_module(module_str)
File "/usr/lib/python3.8/importlib/init.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1014, in _gcd_import
File "", line 991, in _find_and_load
File "", line 975, in _find_and_load_unlocked
File "", line 671, in _load_unlocked
File "", line 848, in exec_module
File "", line 219, in _call_with_frames_removed
File "/usr/local/lib/python3.8/dist-packages/chatglm_cpp/langchain_api.py", line 51, in
pipeline = chatglm_cpp.Pipeline(settings.model)
File "/usr/local/lib/python3.8/dist-packages/chatglm_cpp/init.py", line 36, in init
from chatglm_cpp.convert import convert
File "/usr/local/lib/python3.8/dist-packages/chatglm_cpp/convert.py", line 12, in
import torch
ModuleNotFoundError: No module named 'torch'

@linmp4
Copy link

linmp4 commented Feb 25, 2024

how to fix it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants