Skip to content

godaudits 2.12.0

Choose a tag to compare

View all tags
@hannsxpeter hannsxpeter released this 23 Jul 05:25
v2.12.0
eeef489
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

First measured-results release.

Evidence result:

  • The first complete A-SEC-6 control versus installed-skill suite reached 15 of 15 pre-authored observations in both arms with no false positives. Measured skill lift is zero on this small suite.
  • The installed-skill arm used 1.94 times the input tokens and 1.82 times the elapsed time.
  • The first public OSS retrospective, auth0/node-jsonwebtoken before the CVE-2015-9235 fix, records zero hits, one miss, and zero adjudicated false positives. The broad missing allowlist was found, but the documented asymmetric-key to HMAC-key confusion path was missed.

Highlights:

  • Retained paired outputs, model and harness attribution, attempt history, and append-only ground-truth corrections.
  • Deterministic regrading separates causal hits, post-run truth, duplicate citations, false positives, and pre-inference technical failures.
  • Public dogfood packages retain source evidence, compiled audit state, generated report, run metadata, redacted transcript, hashes, ground truth, unknowns, and escalation leads.
  • Version and release documentation now publish null and negative evidence without converting near hits after disclosure.

Validation:

  • 140 unit tests
  • 8 benchmark cases
  • 5 evaluation suites
  • official Agent Skills reference validator
  • JSON Schema 2020-12 validation
  • npm package dry run
  • ASCII, catalog, prompt, schema, and zero-dependency gates

See ACCURACY.md and CHANGELOG.md for the full record.

Assets 2
Loading