v0.17.1

What's Changed

New features

• feat(evaluators): add hit@k attack success rate metric by @stefanoamorelli in #2090
  This new metric is currently exposed as terminal output and available per probe/detector pair in the final digest entry of the report.jsonl
• Add Python 3.14 support by @NK-Works in #2297

Improved plugins

• fix(detectors): match mitigation.Prefixes at the start of the response by @chiruu12 in #2067
• fix(detectors): stop FileDetector scoring an unexamined file as a pass by @CTWalk in #2080
• fix(detectors): stop RefusalOnlyAdversarial over-counting skipped multi-turn attempts by @Yigtwxx in #2111
• fix(detectors): scope safe-token suppression to its own match by @feiiiiii5 in #2182
• fix(detectors): Scope ApiKey safe-token suppression to the matching credential by @MRX-72 in #2270
• fix(detectors): Do not treat octal 27 as a raw ANSI escape by @SashaMIT in #2255
• fix(probes): keep promptinject settings aligned with sampled prompts by @reeve25 in #2260
• fix(probes): restore DAN prompt compatibility by @patriciapampanelli in #2282

Documentation

• docs(rest): document updated CLI syntax and generator_options schema by @NK-Works in #2279

Tuning & fixes

• fix(generators): raise clear error on HF InferenceAPI 404 response by @pujitha24 in #2112
• fix(buffs): use prompt setter in paraphrase buffs to update conversations by @bodapatisaikrishna in #2200
• fix: deep-copy mutable attempt state in Buff._derive_new_attempt by @pujitha24 in #2156
• fix(buffs): preserve attempt attributes and isolate mutable state in _derive_new_attempt by @bodapatisaikrishna in #2198
• fix: reuse the WebSocket event loop across calls by @Vamsi-2581 in #2269
• fix: respect parallel_capable for generator requests by @denelbjohn18 in #2274
• probes: factor up local prompt-cap logic into probes.base by @VishnuR23 in #2085
• task: update deps for security hygiene by @jmartin-tech in #2311
• lock transformers due to interface changes by @jmartin-tech in #2316
• Use --target_name as the WebSocket generator uri by @Somay-kousis in #2315
• report: update report probe tooltip text to be accurate (higher=better) by @leondz in #2317

New Contributors

• @bodapatisaikrishna made their first contribution in #2200
• @pujitha24 made their first contribution in #2112
• @Vamsi-2581 made their first contribution in #2269
• @denelbjohn18 made their first contribution in #2274
• @MRX-72 made their first contribution in #2270
• @reeve25 made their first contribution in #2260
• @VishnuR23 made their first contribution in #2085
• @SashaMIT made their first contribution in #2255
• @NK-Works made their first contribution in #2297
• @chiruu12 made their first contribution in #2067
• @CTWalk made their first contribution in #2080
• @Yigtwxx made their first contribution in #2111
• @Somay-kousis made their first contribution in #2315

Full Changelog: v0.17.0...v0.17.1