Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[azopenaiassistants] Streaming Support #22857

Open
pkrauss-prot opened this issue May 7, 2024 · 1 comment
Open

[azopenaiassistants] Streaming Support #22857

pkrauss-prot opened this issue May 7, 2024 · 1 comment
Assignees
@richardpark-msft
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that

Comments

@pkrauss-prot
Copy link

Feature Request

This could very well need changes from the Service API also. However, if the Service API already supports Streaming, can we add support for streaming assistant messages. I'am sure this does not need explaining but given the computation heavy prompts its nice to stream results as they come, rather than waiting the entire round trip. While the interfaces are not exactly the same, I believe the Service API layer is similar to support parity with the releases on Openai's side given the partnership.

https://community.openai.com/t/streaming-is-now-available-in-the-assistants-api/682011

If or when this feature is added it would be great to include in the examples and documentation regarding working streaming into common existing workflows like tools and such.
@github-actions github-actions bot added Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that labels May 7, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented May 7, 2024

Thank you for your feedback. Tagging and routing to the team member best able to assist.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@richardpark-msft richardpark-msft

Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@richardpark-msft @pkrauss-prot