Skip to content

Releases

v0.2.1 — Decoupled Domain Adapters, Trajectory Pruner & MCP SDK v2.x Support

Choose a tag to compare

@snowyLumiere snowyLumiere released this 20 Nov 05:00

Highlights

Unit tests check single tool calls. Real agents fail on multi-step contracts.

MCP-CrashTest v0.2.1 is now live on PyPI: run it immediately with uvx mcp-crashtest.

What's New in v0.2.1

  • Clean Architecture Split (--adapter none|auto|<name>): Decoupled the core zero-shot stateful fuzzing engine from optional domain contract adapters (mcp_crashtest/adapters/{filesystem,sqlite,memory,git}.py). Every report tags each finding with its exact provenance (generic vs adapter:<name>).
  • Trajectory Minimization (mcp_crashtest/pruner.py): Added static backward dependency slicing + live sandbox replay delta-debugging so Minimal Reproducers strip unrelated prefix steps (e.g. 5-step noisy walks shrink to clean 1-step / 2-step JSON-RPC traces).
  • Calibrated Finding Taxonomy: Separated hard Protocol Violations (CRITICAL/HIGH, such as masked isError: false failures and stdio deadlocks) from Agent Contract Smells (CONTRACT_SMELL, MEDIUM/LOW/INFO), with CI gate control via --fail-on-crash --fail-on protocol|any.
  • MCP Python SDK v1.x & v2.x Dual Compatibility: Supports both inputSchema/isError (v1.x) and input_schema/is_error (v2.x).
  • Engineering Fixes & Bilingual Reports: Context-memory rollback now works under --sandbox none, local isolated random.Random(seed), initialize()/list_tools() timeouts, and --lang en|zh reports.

Live Verification Snapshot (2026-11-20)

  • mcp-server-sqlite (archived reference server, PyPI): Even in pure zero-shot --adapter none mode, independently caught all 3 CRITICAL isError: false masked errors (write_query, create_table, read_query, 1-step reproducers).
  • mcp-server-git (active official reference server): Caught 4 HIGH SCHEMA_BREAK cross-tool failures where git_branch leaks '* main' into git_checkout / git_diff / git_show / git_merge (2-step reproducers).
  • @modelcontextprotocol/server-filesystem & server-memory: 0 protocol violations; surfaced calibrated MEDIUM / LOW / INFO contract smells.

Install / Run

uvx mcp-crashtest --adapter none --seed 42 --fail-on-crash --fail-on protocol -- python3 my_server.py --root {sandbox}