Skip to content

Getting two traces with Human-in-the-loop #2540

@gemue-parndt

Description

@gemue-parndt

Question

Hey everyone, first of all, I love the HITL feature!

I've implemented HITL and use Phoenix as an open-source alternative to the OpenAI traces dashboard for viewing the traces. :)

Here’s my workflow:

  1. The LLM generates text.
  2. The LLM attempts to call the "write_page" tool, which requires approval.
  3. The user clicks "approve".
  4. The LLM executes the tool call.
  5. The LLM returns its response.

Everything works well, but I notice that instead of a single trace, I end up with two traces:

  • The first trace covers steps 1–2 and is ending with the tool call .
  • The second trace includes steps 4–5 (step 3 isn’t shown, which makes sense since it’s not an LLM action) and is starting with the tool call.

Does anyone have suggestions or tips on how to combine these traces, or is this split the expected behavior?

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions