[Question]: [ERROR][Exception]: Exceptions from Trio nursery (3 sub-exceptions) -- 'LmStudioChat' object has no attribute 'max_retries'

[superwiboy]

Self Checks

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (Language Policy).
• Non-english title submitions will be closed directly ( 非英文标题的提交将会被直接关闭 ) (Language Policy).
• Please do not modify this template :) and fill in all the required fields.

Describe your problem

"llm_id": "mlx-community/deepseek-r1-distill-qwen-1.5b@LM-Studio", "update_time": 1742999292472, "task_type": "raptor"}

• Exception Group Traceback (most recent call last):
  | File "/ragflow/rag/svr/task_executor.py", line 600, in handle_task
  | await do_handle_task(task)
  | File "/ragflow/rag/svr/task_executor.py", line 517, in do_handle_task
  | chunks, token_count = await run_raptor(task, chat_model, embedding_model, vector_size, progress_callback)
  | File "/ragflow/rag/svr/task_executor.py", line 445, in run_raptor
  | chunks = await raptor(chunks, row["parser_config"]["raptor"]["random_seed"], callback)
  | File "/ragflow/rag/raptor.py", line 150, in call
  | async with trio.open_nursery() as nursery:
  | File "/ragflow/.venv/lib/python3.10/site-packages/trio/_core/_run.py", line 1058, in aexit
  | raise combined_error_from_nursery
  | exceptiongroup.ExceptionGroup: Exceptions from Trio nursery (3 sub-exceptions)
  +-+---------------- 1 ----------------
  | Traceback (most recent call last):
  | File "/ragflow/rag/raptor.py", line 96, in summarize
  | cnt = await self._chat(
  | File "/ragflow/rag/raptor.py", line 48, in _chat
  | response = await trio.to_thread.run_sync(
  | File "/ragflow/.venv/lib/python3.10/site-packages/trio/_threads.py", line 447, in to_thread_run_sync
  | return msg_from_thread.unwrap()
  | File "/ragflow/.venv/lib/python3.10/site-packages/outcome/_impl.py", line 213, in unwrap
  | raise captured_error
  | File "/ragflow/.venv/lib/python3.10/site-packages/trio/_threads.py", line 373, in do_release_then_return_result
  | return result.unwrap()
  | File "/ragflow/.venv/lib/python3.10/site-packages/outcome/_impl.py", line 213, in unwrap
  | raise captured_error
  | File "/ragflow/.venv/lib/python3.10/site-packages/trio/_threads.py", line 392, in worker_fn
  | ret = context.run(sync_fn, *args)
  | File "/ragflow/rag/raptor.py", line 49, in
  | lambda: self._llm_model.chat(system, history, gen_conf)
  | File "/ragflow/api/db/services/llm_service.py", line 314, in chat
  | txt, used_tokens = self.mdl.chat(system, history, gen_conf)
  | File "/ragflow/rag/llm/chat_model.py", line 99, in chat
  | for attempt in range(self.max_retries):
  | AttributeError: 'LmStudioChat' object has no attribute 'max_retries'
  +---------------- 2 ----------------
  | Traceback (most recent call last):
  | File "/ragflow/rag/raptor.py", line 96, in summarize
  | cnt = await self._chat(
  | File "/ragflow/rag/raptor.py", line 48, in _chat
  | response = await trio.to_thread.run_sync(
  | File "/ragflow/.venv/lib/python3.10/site-packages/trio/_threads.py", line 447, in to_thread_run_sync
  | return msg_from_thread.unwrap()
  | File "/ragflow/.venv/lib/python3.10/site-packages/outcome/_impl.py", line 213, in unwrap
  | raise captured_error
  | File "/ragflow/.venv/lib/python3.10/site-packages/trio/_threads.py", line 373, in do_release_then_return_result
  | return result.unwrap()
  | File "/ragflow/.venv/lib/python3.10/site-packages/outcome/_impl.py", line 213, in unwrap
  | raise captured_error
  | File "/ragflow/.venv/lib/python3.10/site-packages/trio/_threads.py", line 392, in worker_fn
  | ret = context.run(sync_fn, *args)
  | File "/ragflow/rag/raptor.py", line 49, in
  | lambda: self._llm_model.chat(system, history, gen_conf)
  | File "/ragflow/api/db/services/llm_service.py", line 314, in chat
  | txt, used_tokens = self.mdl.chat(system, history, gen_conf)
  | File "/ragflow/rag/llm/chat_model.py", line 99, in chat
  | for attempt in range(self.max_retries):
  | AttributeError: 'LmStudioChat' object has no attribute 'max_retries'
  +---------------- 3 ----------------
  | Traceback (most recent call last):
  | File "/ragflow/rag/raptor.py", line 96, in summarize
  | cnt = await self._chat(
  | File "/ragflow/rag/raptor.py", line 48, in _chat
  | response = await trio.to_thread.run_sync(
  | File "/ragflow/.venv/lib/python3.10/site-packages/trio/_threads.py", line 447, in to_thread_run_sync
  | return msg_from_thread.unwrap()
  | File "/ragflow/.venv/lib/python3.10/site-packages/outcome/_impl.py", line 213, in unwrap
  | raise captured_error
  | File "/ragflow/.venv/lib/python3.10/site-packages/trio/_threads.py", line 373, in do_release_then_return_result
  | return result.unwrap()
  | File "/ragflow/.venv/lib/python3.10/site-packages/outcome/_impl.py", line 213, in unwrap
  | raise captured_error
  | File "/ragflow/.venv/lib/python3.10/site-packages/trio/_threads.py", line 392, in worker_fn
  | ret = context.run(sync_fn, *args)
  | File "/ragflow/rag/raptor.py", line 49, in
  | lambda: self._llm_model.chat(system, history, gen_conf)
  | File "/ragflow/api/db/services/llm_service.py", line 314, in chat
  | txt, used_tokens = self.mdl.chat(system, history, gen_conf)
  | File "/ragflow/rag/llm/chat_model.py", line 99, in chat
  | for attempt in range(self.max_retries):
  | AttributeError: 'LmStudioChat' object has no attribute 'max_retries'

[dosubot]

Hello @superwiboy! I'm here to assist you with any bugs, questions, or contributions. Let's work together to resolve any issues you may have.

To resolve the AttributeError: 'LmStudioChat' object has no attribute 'max_retries', you need to ensure that the LmStudioChat class has the max_retries attribute defined. This attribute is being accessed in the code, but it has not been initialized or defined in the class.

You can add the max_retries attribute to the LmStudioChat class, possibly in the class's __init__ method, like this:

class LmStudioChat:
    def __init__(self, max_retries=3, ...):  # Add other parameters as needed
        self.max_retries = max_retries
        # Initialize other attributes

Make sure to replace 3 with the desired default number of retries or pass it as an argument when creating an instance of LmStudioChat. This should resolve the AttributeError ^[1].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}