Skip to content

v0.2.1 - CI that proves the red before it trusts the green

Choose a tag to compare

@tonydzi tonydzi released this 02 Oct 19:09
· 113 commits to main since this release

The suite stopped being something a human remembers to run. The 84 tests and the eval suite shipped in v0.2.0 had only ever been run by hand. .github/workflows/tests.yml now runs them on every push against Python 3.11, 3.12 and 3.13.

It carries one step that is not boilerplate: the workflow sets EVAL_MUTANT=1, which breaks the retrieval pipeline on purpose, and fails the build if the eval suite still comes back green. A test that has never been seen red is not evidence of anything, so the pipeline proves its own detection before it trusts a passing run. If someone later guts the retrieval stages and the eval keeps smiling, CI stops the push instead of the user discovering it.

Read this with AI. One click opens the repo in Codex, ChatGPT or Claude with a prompt that asks the agent to extract the reusable patterns and apply them to your own setup; the raw prompt is there for any other model. The README also names the neighbouring repos in the memory layer, so the piece can be placed in the system it was lifted out of.

One correction. A commit on 30 September "corrected" a measurement date in the docs, and it was reverted the same day: the original date was right, and the machine making the correction was the one with the wrong clock. Recorded rather than quietly dropped, because the repo's own argument is that the measurement date matters.