v0.15.0

What's Changed

New plugins

• probes: Add multi-turn GOAT probe by @saichandrapandraju in #1424
• probes: Agent breaker by @eliyacohen-hub in #1628
• probes: Added system prompt extraction probe by @Nakul-Rajpal in #1538
• probes: add homoglyph obfuscation prompts to smuggling probe by @dentity007 in #1660
• detectors: Add ModernBERT refusal detector by @patriciapampanelli in #1650
• generators: NeMoGuardrails server support by @jmartin-tech in #1675
• generators: test generator with reasoning traces by @leondz in #1697

New features

• Agent breaker probe by @eliyacohen-hub in #1628 adds support for testing tools available to target systems.

Improved plugins

• generators: add mTLS client certificate authentication to REST generator by @JakeBx in #1681
• generators: Add support for reasoning models to Bedrock generator by @TheTeaCat in #1642
• detectors: limit tensor length passed to roberta by @leondz in #1715
• probes: Enforce soft_probe_prompt_cap in GCGCached probe by @precognitivem0nk in #1665
• detectors: fix logic flip bug in encoding detection, add tests to catch by @leondz in #1711

Documentation

• docs: structure docs out of flat dir into tree by @leondz in #1662
• docs: explicitly enumerate configurable params in docs by @leondz in #1683

Tuning & fixes

• fix: prevent semaphore leak by @r3v5 in #1657
• Replace base2048 with mikeshardmind-base2048 and add spec tests by @onceandtwice in #1518
• fix: remove duplicate status:2 attempt writes in TreeSearchProbe by @Christbowel in #1655
• task: dependency updates by @jmartin-tech in #1678
• fix: report_digest -t taxonomy option not working by @HayatoFujihara in #1672
• fix: use magic.from_file() instead of from_buffer() for libmagic 5.47 compatibility by @HayatoFujihara in #1671
• housekeeping: prune phantom rapidfuzz dep by @leondz in #1701
• housekeeping: supply hook for signing, document signing prefs by @leondz in #1702
• first version of AGENTS.md by @leondz in #1698
• bug: avoid TBSA double horizontal rule by @leondz in #1712
• Handle unrecognized probes and detectors in report digest generation by @precognitivem0nk in #1663
• report: snapshot plugin cache into report jsonl by @patriciapampanelli in #1723
• docs: add build test for docs by @leondz in #1713
• improve compatibility with older reports by @jmartin-tech in #1728

New Contributors

• @r3v5 made their first contribution in #1657
• @onceandtwice made their first contribution in #1518
• @TheTeaCat made their first contribution in #1642
• @Christbowel made their first contribution in #1655
• @HayatoFujihara made their first contribution in #1672
• @precognitivem0nk made their first contribution in #1665
• @JakeBx made their first contribution in #1681
• @eliyacohen-hub made their first contribution in #1628
• @dentity007 made their first contribution in #1660

Full Changelog: v0.14.1...v0.15.0