Skip to content

braintrust@3.37.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 05 Oct 16:59
· 9 commits to main since this release
braintrust@3.37.0
672220e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

braintrust

3.37.0

Minor Changes

  • feat(evals): Add cooperative cancellation via signal in task hooks When an eval hits its timeout or its signal aborts, it now stops scheduling new trials, aborts the new signal in the task hooks, and waits for in-flight tasks and scorers to settle before rejecting. Previously the eval rejected right away and left running tasks going in the background. Pass hooks.signal to the APIs your task calls (or check signal.aborted) to stop work early. (#2549)
  • feat(workflow-eval): Add batch tasks and scorers (#2548)

Patch Changes

  • fix(eve): Support Eve 0.62+ and 0.70 (#2572)
  • fix: Log output and token metrics for OpenAI Responses API streams that end with response.incomplete or response.failed, and log the error for response.failed Thanks Raphael Fakhri (@RaphaelFakhri)! (#2540)
  • fix: Fix claude token usage stats (#2544)
  • fix(eve): Nest turns under the caller's propagated trace context (#2574)

Contributors

RaphaelFakhri
Assets 3
Loading