Client disconnects before response is received

[drewwells]

Bug description

If an answer takes several minutes to complete, the chat-ui client simply disconnects. This disconnection happens at 1 minute, but I'm unsure.

Steps to reproduce

Ask your LLM a riddle but change it a little, so it becomes confused and wonders for a while.

man and a goat are one one side of a river with a boat. How do they get across?

Notice that the response is terminated during thinking/reasoning phase.

The LM Studio logs indicates that the client disconnects so it terminates the response at that point.

Screenshots

Context

Logs

This request is terminated as 1min in the browser.

curl 'https://example.com/conversation/67e1af3d9becaf215b19d526' \
-X 'POST' \
-H 'Content-Type: multipart/form-data; boundary=----WebKitFormBoundarywFDiAu9glkYBEPBf' \
-H 'Accept: */*' \
--data-binary $'------WebKitFormBoundarywFDiAu9glkYBEPBf\r\nContent-Disposition: form-data; name="data"\r\n\r\n{"id":"91f280d4-9852-4453-b941-582eb531e911","is_retry":true,"is_continue":false,"web_search":false,"tools":[]}\r\n------WebKitFormBoundarywFDiAu9glkYBEPBf--\r\n'

Specs

• OS: OS X
• Browser: Orion
• chat-ui commit: chat-ui-db image: ghcr.io/huggingface/chat-ui-db@sha256:a69b02884d0de64bb60d8011828b0e4be778673cadfc5f783fe6df14fa737504

Config

Notes

How do I configure these timeouts?

[nsarrazin]

Hi, just to clarify, are you getting reasoning tokens or is it timing out because you're not getting an update while it thinks?

[drewwells]

Good question, I am getting reasoning tokens. It just stops at exactly 1min when client sends some sort of cancel/timeout to the server.