Repository navigation
AgentEval v0.1.0a1
Pre-release
Pre-release
First standalone public release of AgentEval.
- Evaluate text conversations or cleaned trace trees with trusted code rules and configurable model judges.
- Preserve full trace IDs and distinguish PASS, FAIL, N/A and evaluation errors.
- Open self-contained HTML reports or consume structured JSON.
- Run the bundled offline demo without an API key.
Validation: 8 offline tests, source/wheel builds, and an installed-wheel demo in a separate environment. Model integration tests use a mock provider; this release makes no claim about judge accuracy. Automatic evaluator repair and regression acceptance remain roadmap items.
Python 3.10+. MIT. Install the attached wheel or follow the repository quick start. Package distribution name: agenteval-traces; command: agenteval.