-
-
Notifications
You must be signed in to change notification settings - Fork 58
[Platform][Ollama] Support streaming output #339
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Can you please add an example in examples/ directory? Thanks |
@OskarStark updated with an example |
Thanks It looks like your committer email is not associated with your GitHub account |
@OskarStark thanks, hadn't noticed that. Added. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @logicalor for reporting and working on this - we need this :)
Made some comments, but i think all in all we're close to merging it 👍
Co-authored-by: Christopher Hertel <mail@christopher-hertel.de>
@chr-hertel I was running |
Both a bug fix and a feature? Support streaming output from Ollama, preventing an error being thrown if streaming output is sent with the chat request.