v0.15.0

[jmartin-tech]

What's Changed

New plugins

• probes: Add multi-turn GOAT probe by @saichandrapandraju in feat(probes): Add multi-turn GOAT probe #1424
• probes: Agent breaker by @eliyacohen-hub in Agent breaker #1628
• probes: Added system prompt extraction probe by @Nakul-Rajpal in Added system prompt extraction probe #1538
• probes: add homoglyph obfuscation prompts to smuggling probe by @dentity007 in feat: add homoglyph obfuscation prompts to smuggling probe #1660
• detectors: Add ModernBERT refusal detector by @patriciapampanelli in Add ModernBERT refusal detector #1650
• generators: NeMoGuardrails server support by @jmartin-tech in generator: NeMoGuardrails server support #1675
• generators: test generator with reasoning traces by @leondz in generators: test generator with reasoning traces #1697

New features

• Agent breaker probe by @eliyacohen-hub in Agent breaker #1628 adds support for testing tools available to target systems.

Improved plugins

• generators: add mTLS client certificate authentication to REST generator by @JakeBx in feat: add mTLS client certificate authentication to REST generator #1681
• generators: Add support for reasoning models to Bedrock generator by @TheTeaCat in Add support for reasoning models to Bedrock generator #1642
• detectors: limit tensor length passed to roberta by @leondz in bug: limit tensor length passed to roberta #1715
• probes: Enforce soft_probe_prompt_cap in GCGCached probe by @precognitivem0nk in Enforce soft_probe_prompt_cap in GCGCached probe #1665
• detectors: fix logic flip bug in encoding detection, add tests to catch by @leondz in bug: fix logic flip bug in encoding detection, add tests to catch #1711

Documentation

• docs: structure docs out of flat dir into tree by @leondz in docs: structure docs out of flat dir into tree #1662
• docs: explicitly enumerate configurable params in docs by @leondz in docs: explicitly enumerate configurable params in docs #1683

Tuning & fixes

• fix: prevent semaphore leak by @r3v5 in fix: prevent semaphore leak #1657
• Replace base2048 with mikeshardmind-base2048 and add spec tests by @onceandtwice in Replace base2048 with mikeshardmind-base2048 and add spec tests #1518
• fix: remove duplicate status:2 attempt writes in TreeSearchProbe by @Christbowel in fix: remove duplicate status:2 attempt writes in TreeSearchProbe #1655
• task: dependency updates by @jmartin-tech in task: dependency updates #1678
• fix: report_digest -t taxonomy option not working by @HayatoFujihara in fix: report_digest -t taxonomy option not working #1672
• fix: use magic.from_file() instead of from_buffer() for libmagic 5.47 compatibility by @HayatoFujihara in fix: use magic.from_file() instead of from_buffer() for libmagic 5.47 compatibility #1671
• housekeeping: prune phantom rapidfuzz dep by @leondz in housekeeping: prune phantom rapidfuzz dep #1701
• housekeeping: supply hook for signing, document signing prefs by @leondz in housekeeping: supply hook for signing, document signing prefs #1702
• first version of AGENTS.md by @leondz in first version of AGENTS.md #1698
• bug: avoid TBSA double horizontal rule by @leondz in bug: avoid TBSA double horizontal rule #1712
• Handle unrecognized probes and detectors in report digest generation by @precognitivem0nk in Handle unrecognized probes and detectors in report digest generation #1663
• report: snapshot plugin cache into report jsonl by @patriciapampanelli in report: snapshot plugin cache into report jsonl #1723
• docs: add build test for docs by @leondz in docs: add build test for docs #1713
• improve compatibility with older reports by @jmartin-tech in improve compatibility with older reports #1728

New Contributors

• @r3v5 made their first contribution in fix: prevent semaphore leak #1657
• @onceandtwice made their first contribution in Replace base2048 with mikeshardmind-base2048 and add spec tests #1518
• @TheTeaCat made their first contribution in Add support for reasoning models to Bedrock generator #1642
• @Christbowel made their first contribution in fix: remove duplicate status:2 attempt writes in TreeSearchProbe #1655
• @HayatoFujihara made their first contribution in fix: report_digest -t taxonomy option not working #1672
• @precognitivem0nk made their first contribution in Enforce soft_probe_prompt_cap in GCGCached probe #1665
• @JakeBx made their first contribution in feat: add mTLS client certificate authentication to REST generator #1681
• @eliyacohen-hub made their first contribution in Agent breaker #1628
• @dentity007 made their first contribution in feat: add homoglyph obfuscation prompts to smuggling probe #1660

Full Changelog: v0.14.1...v0.15.0

---

This discussion was created from the release v0.15.0.