Skip to content

v0.4.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 11 Jun 10:56
· 27 commits to main since this release
v0.4.0
0716e13
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Minor Changes

  • 3025c00: Benchmark: support per-config answer generation. BenchmarkConfig gains optional generateFn / generateModel overrides so configurations that generate answers differently (e.g. different generation models or end-to-end orchestrations) can be compared in one run. Omitting them keeps the shared run-level pair — existing callers are unaffected. When per-config models differ, the summary's versionMeta.generateModel becomes an explicit name=model; name=model aggregate and the comparison table lists the generation model per configuration.
Assets 2
Loading