Repository navigation
0.1.18
Enhance goal evaluation in BrowserScenarioRunner. Better support of non-OpenAI models.
- Updated
_evaluate_goalmethod to accept an optionalplanner_reasoningparameter, allowing the inclusion of planner context during goal evaluation. - Modified the construction of conversation text to append planner assessments when available, improving the evaluation context.
- Adjusted screenshot handling in
GoalEvaluatorto utilizeBinaryContentfor multimodal evaluation, enhancing compatibility with planner outputs.