🚀 ToolGuard v1.2.0: The "Enterprise Runtime" Update #3
Harshit-J004
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
We just shipped the exact three missing features that finally turn ToolGuard from a "cool testing tool" into the undeniable Default Reliability Infrastructure for AI agents.
If you are treating your AI agents like actual software, you need enterprise-grade testing hooks. Here is what we just rolled out to make ToolGuard feel exactly like PyTest for LLMs:
1. ⏪ Local Crash Replay (The Holy Grail of Debugging)
When an agent crashes in production because of a deeply nested bad JSON payload, it's a nightmare to reproduce. Not anymore.
We added the
--dump-failuresflag. If a tool crashes anywhere in your chain, ToolGuard automatically saves the exact dictionary payload to.toolguard/failures/.You simply type
toolguard replay <file.json>and we dynamically inject the exact crashing state directly back into your local Python function instantly!2. 🎯 Edge-Case Test Coverage (Stop Guessing)
You don't just want a "Reliability Score"; you want to know exactly what scenarios you missed.
The Console Reporter now generates PyTest-style coverage metrics based on our 8 known hallucination categories. If you only test Happy Paths and Nulls, ToolGuard will explicitly print
Coverage: 25%and give you a bulleted list of the exact fuzzer categories (likelarge_payload_overflowortype_mismatch) that your agent is still vulnerable to.3. ⚡ The Minimal API (1-Line Jupyter Testing)
We wanted to make adoption literally zero-friction, especially for students and quick prototypes.
We shipped
toolguard.quick_check(my_agent_function)—an absolute minimalist 1-line Python wrapper. You can pull it into any Jupyter Notebook, run it, and instantly trigger a full deterministic fuzzing sweep with a gorgeous terminal output without touching the CLI or writing a single config file.ToolGuard mathematically proves your agent execution layer survives LLM hallucinations. We don't make your AI smarter; we make sure your code doesn't break when your AI does something stupid.
Update your pip package and check out the new Replay engine!
This discussion was created from the release 🚀 ToolGuard v1.2.0: The "Enterprise Runtime" Update.
All reactions