Skip to content

Conversation

@pmeier
Copy link
Member

@pmeier pmeier commented Mar 11, 2024

Previously, we indeed tested stream=True, but we used the demo assistant to do it which does not support streaming. Meaning, we only ever got a single chunk from the API.

Test for this was proposed in #317 (review).

@pmeier pmeier requested a review from nenb March 11, 2024 10:03
Copy link
Contributor

@nenb nenb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work, can see this being a very useful safety feature in the future 🚀 .

Sorry I didn't follow through on this.

@pmeier pmeier merged commit 4a667f9 into main Mar 11, 2024
@pmeier pmeier deleted the api-streaming branch March 11, 2024 20:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants