Skip to content

Releases

v1.1.0

Choose a tag to compare

@github-actions github-actions released this 10 Nov 18:00
5e950cb

What's Changed

  • feat(v1.1): Anthropic SSE streaming replay, zero-network guard, Go SDK, and TracePort v1.1 interop by @aloneangel45 in #2

New Contributors

Full Changelog: v1.0.0...v1.1.0

v1.0.0 - Deterministic CI/CD Cassettes for AI Agents

Choose a tag to compare

@aloneangel45 aloneangel45 released this 05 Nov 20:51

AgentFixture v1.0.0 — Zero-Dollar Deterministic CI/CD Regression Testing Cassettes for AI Agents

We are thrilled to announce the official v1.0.0 release of AgentFixture, an open-source testing harness and cassette runner engineered to eliminate the high API costs and flaky non-determinism of testing autonomous AI coding agents in Continuous Integration.

Key Capabilities

  • ** CI/CD Regression Testing**: Replays full multi-step agent interactions offline, reducing LLM API testing costs to .00.
  • TracePort Flight Ingestion: Direct native converter for TracePort black-box flight recordings (model.Session JSON) into standardized cassettes (version: agentfixture/v1).
  • Strict & Fuzzy Matchers: Canonical SHA-256 hash matcher for exact reproducibility and semantic fuzzy matcher with dynamic key exclusion.
  • Deterministic HTTP & Stdio Proxies: In-process reverse proxy and JSON-RPC / MCP tool replayer for seamless drop-in agent evaluation.
  • Automatic Secret Redaction: Masks Anthropic keys, OpenAI keys, GitHub tokens, and Bearer tokens to protect repositories from credential leaks.
  • Assertion & Drift Reporting: Comprehensive CLI reports detailing missing interactions, unexpected calls, prompt drift, and token savings metrics.

Release Assets & Verification

Pre-compiled standalone binaries for Windows, Linux, and macOS are attached below along with checksums.txt for SHA-256 validation.

Full Changelog: https://github.com/aloneangel45/AgentFixture/commits/v1.0.0