Skip to content

Choose a tag to compare

@mavericksea-ai mavericksea-ai released this 15 Sep 18:11
· 1 commit to main since this release

A fix release for the badge, the judge and the differ's wording. If you render a Driftproof badge, or pin the Action or the plugin at 0.10.1, update. Plugin users get the badge fixes only after claude plugin update.

Two external audits of 0.10.1, an end-to-end retest and a reliability audit, found the badge and judge defects; the site's findings page (docs/findings/) records both audits, what this release fixes, and what it does not. The receipt spec is unchanged at v0.6.

What this release contains

  • The badge rechecks retained judge output. On 0.10.1 /driftproof:badge rechecked each retained generation text against its receipt and nothing else, so a receipt whose retained judge output had been edited still rendered a passing badge. It now refuses a receipt when any retained judge text no longer digests to the judge_sample_hashes the receipt carries (spec 031).
  • The badge says what it checked. Its statement no longer says judge text is not retained when the transcripts beside the receipt hold it (spec 031).
  • The comparison caveat prints only when it is true. driftproof diff printed that a comparison was not like for like whenever either receipt's band carried a source label. It now prints only when the two receipts' band sources differ (spec 031).
  • The band wording. A band is the mean plus or minus one standard deviation, a descriptive spread and not a confidence interval. driftproof diff, the README and the site now state a separation as detected under the rule and a non-separation as none detected at the sample size used. The verdict values underneath, and every machine-facing token, are unchanged. Twelve published records carry a versioned amendment for the old wording (spec 031).
  • A judge score that is not a number is refused. On 0.10.1 a judge reply that parsed with a score of null, false, "" or [] was measured as 0, and true as 1. Such a reply is now refused the way an unparseable reply is, and no score is recorded from it (spec 032).
  • The badge reads transcripts only from inside the transcripts directory. It refuses an index.json entry, or an index.json, that resolves outside it (spec 032).
  • The site gains the findings page, a platform statement on the homepage and in the README, and a scope sentence on the judge policy: the fixed judge governs the reports Driftproof publishes, and a receipt records its own judge in run.judge (spec 033).

Known open

Everything the findings page lists as open: the statistical results of the reliability audit, the single-receipt badge's use of the effect floor alone, TESTED on a receipt with attested false or an incomplete run, the --trusted-skill flag, and Windows, which is untested. The underpowered-verdict rule is decided and is the next spec.