Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[@azure/openai-assistants] run thread with streaming #29090

Closed
boyce-w opened this issue Mar 28, 2024 · 4 comments
Closed

[@azure/openai-assistants] run thread with streaming #29090

boyce-w opened this issue Mar 28, 2024 · 4 comments
Assignees
@glharper
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. feature-request This issue requires a new behavior in the product in order be resolved. needs-team-attention This issue needs attention from Azure service team or SDK team OpenAI Service Attention This issue is responsible by Azure service team.

Comments

@boyce-w
Copy link

boyce-w commented Mar 28, 2024

Package: @azure/openai-assistants
Request: OpenAI now supports the Assistant API with streaming reponse. Please integrate this feature into the azure package.
Reference:
@github-actions github-actions bot added Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team. labels Mar 28, 2024
@github-actions GitHub Actions
Copy link

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @glharper.

@glharper
Copy link
Member

@boyce-w Thanks for using the Azure OpenAI-Assistants SDK for JS. We are aware of the streaming support, and will release a new version once upstream support has been merged.

@xirzec xirzec added feature-request This issue requires a new behavior in the product in order be resolved. and removed question The issue doesn't require a change to the product in order to be resolved. Most issues start as that labels Apr 11, 2024
@yuval-hazaz
Copy link

hi @glharper
Thanks for your work on this!
do you and an ETA on this one?
I can see that the latest version on npm is 1.0.0-beta.5 from 4 months ago

@glharper
Copy link
Member

@yuval-hazaz @boyce-w We are merging support for Azure OpenAI Assistants into the official openai-node library. Please see this comment for a more detailed explanation.

For using Assistants with the openai-node library, see this example. If the underlying AOAI model supports streaming, streaming for assistants should work using that example as a starting point.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@glharper glharper

Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. feature-request This issue requires a new behavior in the product in order be resolved. needs-team-attention This issue needs attention from Azure service team or SDK team OpenAI Service Attention This issue is responsible by Azure service team.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@xirzec @yuval-hazaz @glharper @boyce-w