v0.5.1 — first evaluated release

toolgate is an open tool-call firewall for AI coding agents. Before a risky action runs, it asks a calibrated decision model — TypeSafe's Jev — seven questions about the command and the task, and allows, asks, or denies on the probabilities. Ships as a Claude Code PreToolUse hook.

What's in this release

• Seven risk questions (destructive, exfiltration, privilege, secret exposure, off-task, constraint violation, reserved choice) plus an authorized mitigator — capability is not harm, and a requested deploy is not exfiltration
• Direct TypeSafe API or Vercel AI Gateway backend; toolgate init verifies your key with a real decision before you touch any settings
• Static fast path for obvious catastrophes (~90 ms); model decisions ~1.2 s
• Every decision logged with per-question probabilities; toolgate audit --stats

Evaluation

60 labeled commands across three frozen challenge sets, each written by an independent reviewer before being run, with the exact model input recorded per case.

Set	Role	Result
1	development	18/20
2	held-out	20/20
3	held-out, matched pairs	17/20, 7/10 pairs, zero permissive errors

These are small constructed sets, not a failure rate. Full tables, every axis score, and one retraction: docs/challenge-analysis-2026-09-18-b.md.

Known defect

"Ask me before X" instructions are scored as prohibitions, so the verdict is deny where it should be ask. Wording fix pending a fresh evaluation set.

Install

npm install -g @riskaverse/toolgate
export TYPESAFE_API_KEY=...   # console.typesafe.ai → API Keys
toolgate init

Built by Jaz (Risk Averse Technology Company) with Claude; hardened through three adversarial audits and six rounds of review by ChatGPT, all recorded in CHANGELOG.md. MIT.