toolkitlabs-jsonshim 1.0.0 (Python)
toolkitlabs-jsonshim 1.0.0 - pull the JSON out of a model reply, report every repair, and return nothing when the value cannot be recovered. Standard library only, no network call, no telemetry, CC0-1.0.
There is no PyPI listing, so pip install toolkitlabs-jsonshim does not work. These do:
pip install "git+https://github.com/toolkitlabs/jsonshim#subdirectory=python"
pip install https://github.com/toolkitlabs/jsonshim/releases/download/v1.0.0/toolkitlabs_jsonshim-1.0.0-py3-none-any.whlChecksums of the two assets below (sha256), which also appear at https://toolkitlabs.org/pkg/index.json:
toolkitlabs_jsonshim-1.0.0-py3-none-any.whl- 28,568 B -64c9abfd880295c9ca44d13e53e0ab43f9a5b28c6fc035cc483cb63808eb0ca2toolkitlabs_jsonshim-1.0.0.tar.gz- 22,549 B -f096338d599c26d297b459cb7fd71a9732a1b8e50b533c0136646a6cbb644b07
The scorers jsonshim-score and toolcall-score are installed as commands. The 12 free cases of each corpus are at https://toolkitlabs.org/malformed300/open12.jsonl and https://toolkitlabs.org/toolcall300/open12.jsonl ; the leaderboard is at https://toolkitlabs.org/leaderboard/ .