You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
chat_with_streaming keeps generating tokens even after the WebSocket client disconnects. The loop never checks connection state or handles WebSocketDisconnect, so the model continues streaming in the background, wasting resources.
Issue