Repository navigation
Releases
Releases · behavioral-sh/agent-eval-harness
v1.0.1
What's Changed
- fix: run command graders from trial cwd by @EdwardIrby in #57
- fix(trial): capture proc.signalCode in command invocation by @TheCrowd in #58
- ci: upgrade GitHub Actions to latest versions by @EdwardIrby in #59
New Contributors
Full Changelog: v1.0.0...v1.0.1
v1.0.0
What's Changed
- feat: replace pipeline with agent-build trial tooling by @EdwardIrby in #54
- fix: run command graders from trial cwd by @EdwardIrby in #56
Full Changelog: v0.13.0...v1.0.0
v0.13.0
What's Changed
- fix(trajectory): capture step timestamps at event time and extract tool input/output by @EdwardIrby in #53
Full Changelog: v0.12.2...v0.13.0
v0.12.2
What's Changed
- feat(schemas): add discriminated union to QualityMetricsSchema by @EdwardIrby in #51
Full Changelog: v0.12.1...v0.12.2
v0.12.1
What's Changed
- feat(compare): extract latency and quality metrics from trials data by @EdwardIrby in #49
Full Changelog: v0.12.0...v0.12.1
v0.12.0
What's Changed
- chore: migrate from .plaited/ to .agents/ and update publish workflow by @EdwardIrby in #47
Full Changelog: v0.11.0...v0.12.0
v0.11.0
What's Changed
- feat: add --stdin flag and memory docs for container orchestration by @EdwardIrby in #46
Full Changelog: v0.10.0...v0.11.0
v0.10.0
What's Changed
- feat(capture,trials): add parallelization with worker pool by @EdwardIrby in #44
Full Changelog: v0.9.0...v0.10.0
v0.9.0
What's Changed
- fix(compare): add type discriminator to reliability metrics output by @EdwardIrby in #43
Full Changelog: v0.8.1...v0.9.0
v0.8.1
What's Changed
- feat(compare): add confidence intervals to comparison output by @EdwardIrby in #41
Full Changelog: v0.8.0...v0.8.1