Skip to content

v0.3.0 — Stakeholder Reporting & Judge Refinements

Choose a tag to compare

@HinchK HinchK released this 03 Apr 00:33

New Features

  • Executive summary in HTML reports — color-coded risk badge, plain-English findings, and auto-generated remediation recommendations derived from actual detection results
  • CVSS-AI score explainer — visual severity scale with links to CVSS v4.0, OWASP Top 10 for LLMs, and NIST CVSS Calculator
  • darkarts report reproduce — generates markdown finding cards with exact prompts, classification, detection details, and step-by-step reproduction instructions a human tester can follow
  • Automated PyPI publishing via GitHub Actions with trusted publisher (OIDC) and version tag verification

Improvements

  • Judge rubric refinedharmful-content rubric now distinguishes between a model repeating/quoting adversarial content and actually complying with it (4-point anchored scale with 0.3 meta-analytical tier)
  • Meta-analysis detector — code-level safety net using trigram overlap ratio and signal phrase matching to catch false positives where the model analyzes the prompt rather than executes it; high-confidence detections cap the judge score at 0.3
  • README rewritten — full requirements walkthrough (Python, Git, Ollama setup), quick start guide, complete command reference, CVSS-AI scoring explanation

Fixes

  • Removed stale PyPI badge and broken pip install darkarts instruction from README
  • Fixed license classifier conflict with PEP 639 on Python 3.14
  • Test matrix narrowed to 3.10–3.13 (stable releases)

Full Changelog: v0.2.0...v0.3.0