Skip to content

[Feature] Improve AgentQnA UI #1565

@minmin-intel

Description

@minmin-intel

Priority

P2-High

OS type

Ubuntu

Hardware type

Gaudi2

Running nodes

Single Node

Description

  1. Multi-turn: Example multi-turn python code here.
  2. Stream thinking process: now the agent's AIMessage also has content (thinking process) in addition to tool calls. I believe the content is also printed out. Can you please test to see if the content is streamed to UI?
  3. Show tool calls on UI: is AIMessage.tool_calls (input to tools) shown on UI? Or just the ToolMessage (output from tools)? Would it be possible to show AIMessage.tool_calls? What kind of hooks do you need?
  4. Streaming LLM tokens: how much effort do you think it would take to enable streaming LLM tokens?

Metadata

Metadata

Assignees

Labels

A1high prorityfeatureNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions