Skip to content

0.1.18

Choose a tag to compare

@gusfraser gusfraser released this 29 Mar 22:48
· 1 commit to master since this release

Enhance goal evaluation in BrowserScenarioRunner. Better support of non-OpenAI models.

  • Updated _evaluate_goal method to accept an optional planner_reasoning parameter, allowing the inclusion of planner context during goal evaluation.
  • Modified the construction of conversation text to append planner assessments when available, improving the evaluation context.
  • Adjusted screenshot handling in GoalEvaluator to utilize BinaryContent for multimodal evaluation, enhancing compatibility with planner outputs.