Skip to content

MCP Failure Lab v0.4.0

Choose a tag to compare

View all tags
@anilloutombam anilloutombam released this 21 Aug 06:45
· 13 commits to main since this release
v0.4.0
ee8b27e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What’s new

Scenario result assertions

Scenarios can now validate returned MCP tool results with:

  • expect.result.isError
  • expect.result.textContains

Text matching is case-sensitive and inspects MCP text content only.

Independent observer verification

Scenarios can now run an optional observe call after the primary tool call to verify post-call state through a separate read path.

Observer outcomes, durations, results, errors, and assertion failures are recorded separately and included in console and JSON reports.

Additional improvements

  • Added a built-in deterministic demo command.
  • Added end-to-end CLI coverage.
  • Added Future AGI integration validation.
  • Added trusted npm publishing through GitHub Actions.
  • Updated examples and project documentation.

Included pull requests

  • Built-in demo command: #42
  • End-to-end CLI coverage: #43
  • Trusted npm publishing: #44
  • MCP scenario result assertions: #46
  • Independent observer verification: #47
  • v0.4.0 release preparation: #48

Full changelog: v0.3.2...v0.4.0

Assets 2
Loading