v0.14.1

[jmartin-tech]

What's Changed

New plugins

• generator: Add WebSocket generator for real-time LLM security testing by @dyrtyData in Add WebSocket generator for real-time LLM security testing #1379

New features

• OpenAI Harmony format for audio inputs by @erickgalinkin in feature: OpenAI Harmony format for audio inputs #1618
• add probe tier to --list_probes by @leoneperdigao in feat: add probe tier to --list_probes #1571
• Add Bootstrap Confidence Intervals for Attack Success Rates by @patriciapampanelli in Add Bootstrap Confidence Intervals for Attack Success Rates #1577

Notice: Breaking changes in this release

• remove deprecated nemollm generator and dependencies by @jmartin-tech in remove deprecated nemollm generator and dependencies #1643

Improved plugins

• probes: activate sata & badchars by @leondz in probes: activate sata & badchars #1623
• Add résumé prompt injection examples by @Sid-V5 in Add résumé prompt injection examples #1616
• fix: binary inclusion of jailbreak components now selects correctly by @leondz in fix: binary inclusion of jailbreak components now selects correctly #1621
• Improve Jinja Injection Detection by @erickgalinkin in Improve Jinja Injection Detection #1609

Documentation

• docs: reorganise detector metrics out of code reference section by @leondz in docs: reorganise detector metrics out of code reference section #1617
• docs: improve docs on bar for acceptable probe; link these from other places by @leondz in docs: improve docs on bar for acceptable probe; link these from other places #1647

Tuning & fixes

• reporting: have qual_review support report.jsonl eval entries from 0.13.3 and earlier by @leondz in reporting: have qual_review support report.jsonl eval entries from 0.13.3 and earlier #1605
• linting, 2026 01 30 by @leondz in linting, 2026 01 30 #1587
• bump black version to 26.x, remove pin by @leondz in bump black version to 26.x, remove pin #1591
• Fix core cfg listed twice in report in default run by @arjun-krishna1 in Fix core cfg listed twice in report in default run  #1544
• task: bump yarn dependencies to ensure secure posture by @jmartin-tech in task: bump yarn dependencies to ensure secure posture #1611
• tests: reorg test assets into one dir by @leondz in tests: reorg test assets into one dir #1615
• task: update yarn based dependencies by @jmartin-tech in task: update yarn based dependencies #1631
• task: add report tests automation by @jmartin-tech in task: add report tests automation #1632
• tests: force brew installed libmagic version to 5.46 by @jmartin-tech in tests: force brew installed libmagic version to 5.46 #1635
• task: ensure calls to json.dumps allow non-ascii for language support by @jmartin-tech in task: ensure calls to json.dumps allow non-ascii for language support #1630
• fix: detector description and CLI follow-ups by @patriciapampanelli in fix: detector description and CLI follow-ups #1625
• chore: add optional pre-commit hook for garak-report by @otavionvidia in chore: add optional pre-commit hook for garak-report #1594
• lock litellm by @jmartin-tech in lock litellm #1648
• update yarn.lock for latest packages by @jmartin-tech in update yarn.lock for latest packages #1661
• fix: use parameterized SQL queries in report_digest.py by @gn00295120 in fix: use parameterized SQL queries in report_digest.py #1645
• task: add preliminary build prep action by @jmartin-tech in task: add preliminary build prep action #1570

New Contributors

• @Sid-V5 made their first contribution in Add résumé prompt injection examples #1616
• @dyrtyData made their first contribution in Add WebSocket generator for real-time LLM security testing #1379
• @leoneperdigao made their first contribution in feat: add probe tier to --list_probes #1571
• @gn00295120 made their first contribution in fix: use parameterized SQL queries in report_digest.py #1645

Full Changelog: v0.14.0...v0.14.1

---

This discussion was created from the release v0.14.1.