Repository navigation
Releases
Releases · snowyLumiere/mcp-crashtest
v0.2.1 — Decoupled Domain Adapters, Trajectory Pruner & MCP SDK v2.x Support
Highlights
Unit tests check single tool calls. Real agents fail on multi-step contracts.
MCP-CrashTest v0.2.1 is now live on PyPI: run it immediately with uvx mcp-crashtest.
What's New in v0.2.1
- Clean Architecture Split (
--adapter none|auto|<name>): Decoupled the core zero-shot stateful fuzzing engine from optional domain contract adapters (mcp_crashtest/adapters/{filesystem,sqlite,memory,git}.py). Every report tags each finding with its exact provenance (genericvsadapter:<name>). - Trajectory Minimization (
mcp_crashtest/pruner.py): Added static backward dependency slicing + live sandbox replay delta-debugging so Minimal Reproducers strip unrelated prefix steps (e.g. 5-step noisy walks shrink to clean 1-step / 2-step JSON-RPC traces). - Calibrated Finding Taxonomy: Separated hard Protocol Violations (
CRITICAL/HIGH, such as maskedisError: falsefailures andstdiodeadlocks) from Agent Contract Smells (CONTRACT_SMELL,MEDIUM/LOW/INFO), with CI gate control via--fail-on-crash --fail-on protocol|any. - MCP Python SDK v1.x & v2.x Dual Compatibility: Supports both
inputSchema/isError(v1.x) andinput_schema/is_error(v2.x). - Engineering Fixes & Bilingual Reports: Context-memory rollback now works under
--sandbox none, local isolatedrandom.Random(seed),initialize()/list_tools()timeouts, and--lang en|zhreports.
Live Verification Snapshot (2026-11-20)
mcp-server-sqlite(archived reference server, PyPI): Even in pure zero-shot--adapter nonemode, independently caught all 3CRITICALisError: falsemasked errors (write_query,create_table,read_query, 1-step reproducers).mcp-server-git(active official reference server): Caught 4HIGHSCHEMA_BREAKcross-tool failures wheregit_branchleaks'* main'intogit_checkout/git_diff/git_show/git_merge(2-step reproducers).@modelcontextprotocol/server-filesystem&server-memory: 0 protocol violations; surfaced calibratedMEDIUM/LOW/INFOcontract smells.
Install / Run
uvx mcp-crashtest --adapter none --seed 42 --fail-on-crash --fail-on protocol -- python3 my_server.py --root {sandbox}- 📦 PyPI: https://pypi.org/project/mcp-crashtest/0.2.1/
- 📄 Full reports: reports/