What's Changed
- fix: handle missing metadata in Inspect adapter by @mrshu in #53
- added handling for Inspect eval str only sandbox args by @joeda in #55
- Add metric identity and deterministic aggregate-instance linkage fields by @yananlong in #52
- Update HELM leaderboards parser for schema v0.2.1 by @damian1996 in #56
- fix: handle list[ChatMessage] input in inspect instance level adapter by @SirGankalot in #62
- Add different file uuid for directory mode in inspect converter by @damian1996 in #61
- Move non-core dependencies to optional extras by @j-chim in #71
- Add eval_library into HELM leaderboards scrapper by @damian1996 in #73
- [New Feature] Moving validation from jsonschema -> pydantic + github action to regenerate datamodels and apply post-modification upon schema modification by @nelaturuharsha in #69
- fix action uv.lock by @nelaturuharsha in #74
- chore: regenerate Pydantic types by @github-actions[bot] in #80
- Refactor code into every_eval_ever namespace and add modal CLI by @Erotemic in #57
- Adapter fixes by @nelaturuharsha in #85
New Contributors
- @joeda made their first contribution in #55
- @yananlong made their first contribution in #52
- @SirGankalot made their first contribution in #62
- @j-chim made their first contribution in #71
- @github-actions[bot] made their first contribution in #80
- @Erotemic made their first contribution in #57
Full Changelog: v0.2.1...v0.2.2
Contributors
joeda, mrshu, and 6 other contributors