-
Notifications
You must be signed in to change notification settings - Fork 3.2k
Closed
Labels
Milestone
Description
Question
Hey everyone, first of all, I love the HITL feature!
I've implemented HITL and use Phoenix as an open-source alternative to the OpenAI traces dashboard for viewing the traces. :)
Here’s my workflow:
- The LLM generates text.
- The LLM attempts to call the "write_page" tool, which requires approval.
- The user clicks "approve".
- The LLM executes the tool call.
- The LLM returns its response.
Everything works well, but I notice that instead of a single trace, I end up with two traces:
- The first trace covers steps 1–2 and is ending with the tool call .
- The second trace includes steps 4–5 (step 3 isn’t shown, which makes sense since it’s not an LLM action) and is starting with the tool call.
Does anyone have suggestions or tips on how to combine these traces, or is this split the expected behavior?
Reactions are currently unavailable