Skip to content

EvalCase session state data does not seem to be propagated #5037

@khaledhikmat

Description

@khaledhikmat

Hi, based on my observation and trials, the EvalCase session state data is not propagated. So if I have something like this:

eval_case = EvalCase(
  eval_id = "something",
  conversation = [
    ...
  ],
  session_input = SessionInput(
    app_name = "...",
    user_id = "...",
    state = {
      "some_key": "some_value" 
    }
)

The agent under test does not get the state value in the session. What am I doing wrong? Thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    eval[Component] This issue is related to evaluation

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions