Skip to content

v0.1.0

Choose a tag to compare

@NilkanthSuthar NilkanthSuthar released this 07 Oct 00:04
· 29 commits to main since this release

First release of toolproof: automated tests for MCP servers.

pip install mcp-toolproof

The package is mcp-toolproof on PyPI. The command and the import are both toolproof.

What's in it

  • toolproof inspect: list a server's tools, resources and prompts (table or --json)
  • Static checks for tool definitions: names, descriptions, input/output JSON Schemas, required fields
  • YAML test cases with is_error, equals, contains, regex, jsonpath, max_latency_ms and automatic outputSchema validation
  • toolproof run with per-test timeouts, retries, crash detection and automatic server restart
  • Console, JUnit XML and JSON reports; exit code 0/1 for CI
  • pytest plugin with an mcp_server fixture
  • stdio and streamable HTTP transports
  • Example weather server and a buggy server with planted bugs

See the README for the quickstart and YAML reference.