Repository navigation
agentest v3.5.0 (PyPI: agentest-ai)
agentest 3.5.0 — now on PyPI as agentest-ai
Install:
pip install agentest-aiThe import and the agentest command stay agentest. Python 3.11 or newer. Package page: https://pypi.org/project/agentest-ai/
Upgrade
pip install -U agentest-aiIf you previously installed from git or from a clone, the command above switches you to the PyPI package.
Highlights
- First PyPI release of
agentest-ai3.5.0. The nameagenteston PyPI belongs to a different project. - 30 opt-in New tests (
NT-001–NT-030). Run withagentest std run --ids NTor list withagentest list --new-tests. The default run is still 130 checks (110 checklist + X-001–X-020). - Trace format 1.0.0: specification, JSON Schema, connectors and readers (including D2 aliases and D7/D8 record forms). Verdicts on existing traces are unchanged.
- Connectors for plain OpenTelemetry, LangChain/LangGraph, OpenAI Agents SDK, n8n, and other native-log dialects (steps/CrewAI, events, AutoGen, smolagents, file:).
What's Changed
Other changes
- Duplicate checks: infer user turns in imported native logs (T1-006/T1-011/T2-003) by @srpadmanabhuni in #169
- docs: label the 110-tests article link as 'the original 110 tests' by @srpadmanabhuni in #181
- docs: HF checklist is a practical subset of The original 110 tests by @srpadmanabhuni in #182
- docs: fix HF link in ABOUT.md (CI test_no_hf_links) by @srpadmanabhuni in #187
- fix(T2-006): normalize producer and consumer ID keys by @CyberKun in #168
- Phase 1: New tests NT-001–NT-009 (batch 1) by @srpadmanabhuni in #184
- Phase 1: New tests NT-010–NT-014, NT-027 (batch 2) by @srpadmanabhuni in #183
- Phase 1: New tests NT-020–NT-026, NT-030 (batch 4) by @srpadmanabhuni in #186
- Phase 1: New tests NT-015–NT-019, NT-028, NT-029 + T1-020/T1-021 (batch 3) by @srpadmanabhuni in #185
- Phase 1: New tests coverage counts and article-test mapping (docs roll-up) by @srpadmanabhuni in #188
- test: add T6-003 entity ID drift fixtures by @AdithyaKotian in #180
- fix: help improve detection: X-003 judges reason quality by lengt by @Mr-Neutr0n in #177
- docs: trace format 1.0.0 (D1-D9) and JSON Schema by @srpadmanabhuni in #190
- connectors: plain OTel / Python emitter (trace format 1.0.0) by @srpadmanabhuni in #191
- connectors: importer trace format 1.0.0 + LangChain/LangGraph round trip by @srpadmanabhuni in #192
- connectors: OpenAI Agents SDK round trip (trace format 1.0.0) by @srpadmanabhuni in #193
- connectors: n8n round trip (trace format 1.0.0) by @srpadmanabhuni in #194
- connectors: steps/CrewAI, events, autogen, smolagents, file: round trip (trace format 1.0.0) by @srpadmanabhuni in #195
- reader: trace format D2 aliases + D7 tools.json declarations (verdicts unchanged) by @srpadmanabhuni in #196
- reader: trace format D8 record forms - spans, span events, OTLP log records (verdicts unchanged) by @srpadmanabhuni in #197
- fix: NT-017 and NT-022 read trace-format canonical names by @srpadmanabhuni in #198
- docs: present New tests as shipped (remove Phase 1 wording) by @srpadmanabhuni in #199
- release: agentest-ai 3.5.0 (first PyPI package) by @srpadmanabhuni in #200
New Contributors
- @AdithyaKotian made their first contribution in #180
- @Mr-Neutr0n made their first contribution in #177
Full Changelog: v3.4.0...v3.5.0