Closed
Description
Contact Information
No response
MaxKB Version
v1.10.4-lts
Problem Description
Steps to Reproduce
What's the reason for this?
The expected correct result
No response
Related log output
Traceback (most recent call last):
File "/opt/maxkb/app/apps/setting/models_provider/impl/vllm_model_provider/credential/llm.py", line 50, in is_valid
res = model.invoke([HumanMessage(content=gettext('Hello'))])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/maxkb/app/apps/setting/models_provider/impl/base_chat_open_ai.py", line 155, in invoke
self.generate_prompt(
File "/opt/py3/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 894, in generate_prompt
return self.generate(prompt_messages, stop=stop, callbacks=callbacks, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/py3/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 719, in generate
self._generate_with_cache(
File "/opt/py3/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 960, in _generate_with_cache
result = self._generate(
^^^^^^^^^^^^^^^
File "/opt/py3/lib/python3.11/site-packages/langchain_openai/chat_models/base.py", line 920, in _generate
return generate_from_stream(stream_iter)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/py3/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 115, in generate_from_stream
generation = next(stream, None)
^^^^^^^^^^^^^^^^^^
File "/opt/maxkb/app/apps/setting/models_provider/impl/base_chat_open_ai.py", line 93, in _stream
response = self.client.create(**payload)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/py3/lib/python3.11/site-packages/openai/_utils/_utils.py", line 279, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/opt/py3/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 914, in create
return self._post(
^^^^^^^^^^^
File "/opt/py3/lib/python3.11/site-packages/openai/_base_client.py", line 1242, in post
return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/py3/lib/python3.11/site-packages/openai/_base_client.py", line 919, in request
return self._request(
^^^^^^^^^^^^^^
File "/opt/py3/lib/python3.11/site-packages/openai/_base_client.py", line 1023, in _request
raise self._make_status_error_from_response(err.response) from None
openai.NotFoundError: Error code: 404 - {'detail': 'Not Found'}
10.3.64.30 [16/Apr/2025:15:20:16 +0800] 0.063338s "POST /api/model HTTP/1.1" 200 169Additional Information
No response