-
-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Request] Supports event-streams #55
Comments
@gtk2k we're already using an event-stream parser for responding to the request. Is there a specific change that you're suggesting? |
I just performed a few tests with and without the One thing to keep in mind is that it can feel like the responses take longer when you're not seeing the partial response as ChatGPT is "typing". If you compare the time it takes to fully resolve an To view the stream of partial responses with |
Thank you. I got the expected behavior. |
Just added a note to the readme 👍 |
…e-readme 📝 Update doc for docker and usage
By supporting event-stream, the response will be experientially faster.
The text was updated successfully, but these errors were encountered: