Skip to content

Releases: toolkitlabs/jsonshim

jsonshim v1.0.6 — MALFORMED-300 scorer

Choose a tag to compare

@toolkitlabs toolkitlabs released this 25 Aug 00:43

jsonshim v1.0.6

Score any JavaScript JSON-recovery parser against the MALFORMED-300 conformance suite — same grading spec as the free leaderboard. Zero dependencies, CC0-1.0.

npm i jsonshim

Full labelled corpora (EUR 29 each)

Open 12-case samples are free. The sealed full sets — every case with label rationale — are paid:

MCP stdio server

For agent loops, see release jsonshim-mcp-v1.0.1 or npm i jsonshim-mcp.

jsonshim-mcp v1.0.1 — MCP JSON recovery (0 invented)

Choose a tag to compare

@toolkitlabs toolkitlabs released this 25 Aug 00:12

jsonshim-mcp v1.0.1

One-file MCP stdio server for JSON recovery in agent loops. 218/300 exact, 0 invented values on MALFORMED-300.

npm i jsonshim-mcp

Configure: point your MCP client at mcp/jsonshim_mcp.py (or node_modules/jsonshim-mcp/jsonshim_mcp.py after npm install).

Full corpora (EUR 29 each)

toolkitlabs-jsonshim 1.0.0 (Python)

Choose a tag to compare

@toolkitlabs toolkitlabs released this 20 Aug 09:11

toolkitlabs-jsonshim 1.0.0 - pull the JSON out of a model reply, report every repair, and return nothing when the value cannot be recovered. Standard library only, no network call, no telemetry, CC0-1.0.

There is no PyPI listing, so pip install toolkitlabs-jsonshim does not work. These do:

pip install "git+https://github.com/toolkitlabs/jsonshim#subdirectory=python"
pip install https://github.com/toolkitlabs/jsonshim/releases/download/v1.0.0/toolkitlabs_jsonshim-1.0.0-py3-none-any.whl

Checksums of the two assets below (sha256), which also appear at https://toolkitlabs.org/pkg/index.json:

  • toolkitlabs_jsonshim-1.0.0-py3-none-any.whl - 28,568 B - 64c9abfd880295c9ca44d13e53e0ab43f9a5b28c6fc035cc483cb63808eb0ca2
  • toolkitlabs_jsonshim-1.0.0.tar.gz - 22,549 B - f096338d599c26d297b459cb7fd71a9732a1b8e50b533c0136646a6cbb644b07

The scorers jsonshim-score and toolcall-score are installed as commands. The 12 free cases of each corpus are at https://toolkitlabs.org/malformed300/open12.jsonl and https://toolkitlabs.org/toolcall300/open12.jsonl ; the leaderboard is at https://toolkitlabs.org/leaderboard/ .