Skip to content

evaluate_sync method on Dataset should support retry_task and retry_evaluators arguments #3010

@billiejoe-bw

Description

@billiejoe-bw

Description

evaluate_sync on the Dataset class (for evals) is a

synchronous wrapper around evaluate provided for convenience

but currently it cannot forward the retry_task and retry_evaluators arguments that are needed to supply retry configuration. It would be more convenient if it did that.

(I'm happy to make a PR for that if it's helpful btw; looks like a small change.)

References

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions