Skip to content

AgentEval v0.1.0a1

Pre-release
Pre-release

Choose a tag to compare

@kling01 kling01 released this 20 Oct 07:48
· 4 commits to main since this release

First standalone public release of AgentEval.

  • Evaluate text conversations or cleaned trace trees with trusted code rules and configurable model judges.
  • Preserve full trace IDs and distinguish PASS, FAIL, N/A and evaluation errors.
  • Open self-contained HTML reports or consume structured JSON.
  • Run the bundled offline demo without an API key.

Validation: 8 offline tests, source/wheel builds, and an installed-wheel demo in a separate environment. Model integration tests use a mock provider; this release makes no claim about judge accuracy. Automatic evaluator repair and regression acceptance remain roadmap items.

Python 3.10+. MIT. Install the attached wheel or follow the repository quick start. Package distribution name: agenteval-traces; command: agenteval.