What's Changed
New plugins
- probes: add ProPILE probes for PII leakage detection by @stefanoamorelli in #1504
- generator: add
simonw/llmlibrary support by @Nakul-Rajpal in #1633
New features
Improved plugins
- Fix ggml generator call output handling by @zw5 in #1733
- fix: handle None response.choices in OpenAICompatible by @Christbowel in #1654
- Handle local paths in Hugging Face file probe by @musaabhasan in #1740
- fix(detectors): keep packagehallucination entries with invalid dates by @ChrisJr404 in #1738
- Fix malformed MISP tag on snowball detectors by @adityasingh2400 in #1796
- fix(divergence): guard max_tokens override when the generator lacks it by @adityasingh2400 in #1795
- allow promptinject probes to limit
generation_paramsby @jmartin-tech in #1729 - fix: preserve all turns in NVMultimodal prompt prep by @fallintoplace in #1837
Documentation
- housekeeping: amend arXiv
doc_uris fromhtmlwhere available, elseabsby @leondz in #1750 - Housekeeping: extend
AGENTS.mdby @leondz in #1771 - docs: Update contribution, agent instructions by @leondz in #1819
Tuning & fixes
- chore: remove stale .orig merge artifact from detectors by @markd88 in #1731
- stabilize tests of reasoning lorem generation by @jmartin-tech in #1741
- chore: remove deprecated maxrecall evaluator by @markd88 in #1732
- remove action workflow no longer used as the standard for the project by @jmartin-tech in #1743
- update expectations for litellm proxy to openai by @jmartin-tech in #1777
- fix: when tiktoken encoding is unclear fallback during estimation by @jmartin-tech in #1749
- fix: improve data_path escape protections by @jmartin-tech in #1781
- fix(evaluators): inline score_to_defcon in get_z_rating by @ppradyoth in #1794
- test(config): regression guard for config_files dedup by @ppradyoth in #1791
- test: add tests for evaluators by @r3v5 in #1656
- fix(docs): pin sphinx-rtd-theme>=3.1.0 for Sphinx 9.x compatibility by @AlexanderSanin in #1811
- fix: clearer error when probespec module has only inactive plugins by @notnick2 in #1797
- test: add unit tests for phrasing and sata probe modules by @markd88 in #1747
- Skip invalid payloads in _scan_payload_dir instead of crashing by @Kymi808 in #1810
- bump javascript dependencies by @jmartin-tech in #1839
New Contributors
- @markd88 made their first contribution in #1731
- @zw5 made their first contribution in #1733
- @musaabhasan made their first contribution in #1740
- @stefanoamorelli made their first contribution in #1504
- @ChrisJr404 made their first contribution in #1738
- @0x3df made their first contribution in #1641
- @adityasingh2400 made their first contribution in #1796
- @ppradyoth made their first contribution in #1794
- @AlexanderSanin made their first contribution in #1811
- @notnick2 made their first contribution in #1797
- @Kymi808 made their first contribution in #1810
Full Changelog: v0.15.0...v0.15.1