Skip to content

[WIP] Streaming responses#545

Draft
julien-nc wants to merge 13 commits into
mainfrom
enh/noid/streaming
Draft

[WIP] Streaming responses#545
julien-nc wants to merge 13 commits into
mainfrom
enh/noid/streaming

Conversation

@julien-nc
Copy link
Copy Markdown
Member

Depends on:

This adds the ability to get and display intermediate (streamed) text responses in the chat UI and in the generic form.
We use @nextcloud/notify_push if the notify push service is configured and available. If not, we still get intermediate results with the (pre-existing) task status polling.

Notify push

Kooha-2026-05-18-13-27-53.webm
Kooha-2026-05-18-13-31-56.webm

Polling (fallback)

Kooha-2026-05-18-13-40-25.webm
Kooha-2026-05-18-13-39-28.webm

julien-nc added 9 commits May 18, 2026 13:17
…e task is running and has outputs

Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
…en displaying intermediate results (running + has output)

Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
…sage

Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
…ation task's output

Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
@julien-nc julien-nc requested a review from kyteinsky May 18, 2026 11:46
@julien-nc julien-nc added enhancement New feature or request priority medium labels May 18, 2026
julien-nc added 2 commits May 18, 2026 15:17
…neric form

Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
…ching chat sessions

Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
@DaphneMuller
Copy link
Copy Markdown

That is looking great and will definitely improve the experience of performance for users!
Small nitpick and not critical, but it could be nice to indicate that the answer is still loading for the polling - work with text example.

@julien-nc
Copy link
Copy Markdown
Member Author

There is an indicator already, there is a loading icon next to the task type name at the top of the form (below the task type list):
image

I agree this is not enough. Nothing is definitive in this "WIP" PR.

How would you improve this?

I was thinking of imitating what's done in some other tools: Make the text field border pulse. Right now it is a thick, static, primary color border. It could pulse from border-color to primary color.

Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
@julien-nc julien-nc force-pushed the enh/noid/streaming branch from 8def970 to fc321fd Compare May 18, 2026 14:46
@DaphneMuller
Copy link
Copy Markdown

I don't really know what the best solution is, maybe @marcoambrosini can help with that. Keep in mind that things are good regarding people who don't use animations for motion sickness. Pulsing the border color could be an idea

Signed-off-by: Julien Veyssier <julien-nc@posteo.net>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request priority medium

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants