-
Notifications
You must be signed in to change notification settings - Fork 2.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Streaming support, implementation of IAsyncEnumberalbe #378
Comments
We are working on this. |
did not see this and created other option. link here and follow to close once the issue is solved. I'm using copilot with signalr to connect status change and streaming and the UX changes completely |
Closed
shawncal
added a commit
that referenced
this issue
May 8, 2023
### Motivation and Context Get streaming results from chat completion models using the IAsyncEnumerable pattern. Closes #378 Resolves #378 Added samples how to use those as well as how to implement your own custom chat completion model using streaming capability. Co-authored-by: dedalo <dedalo@gmail.com> Co-authored-by: Shawn Callegari <36091529+shawncal@users.noreply.github.com>
dehoward
pushed a commit
to lemillermicrosoft/semantic-kernel
that referenced
this issue
Jun 1, 2023
### Motivation and Context Get streaming results from chat completion models using the IAsyncEnumerable pattern. Closes microsoft#378 Resolves microsoft#378 Added samples how to use those as well as how to implement your own custom chat completion model using streaming capability. Co-authored-by: dedalo <dedalo@gmail.com> Co-authored-by: Shawn Callegari <36091529+shawncal@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Because I see that Example App Chat Copilot's response is too slow, I would like to ask if Streaming will be implemented in the future.
Additional description:
Nuget package Azure.AI.OpenAI supports Streaming
Example:
The text was updated successfully, but these errors were encountered: