v0.4.0
The documents.
Everything a reader sees around a chart is generated now. Both indexes, and a README in every results directory that says what the numbers were measured on, which versions were measured, what the method was and what the numbers may not be used for. None of it is written by hand, which is the point. 154 chart references maintained by a person go stale on the first rename and nobody finds out until a reader hits a broken image, and the original's README already disagrees with the data sitting next to it.
The generator is a function of its inputs and CI checks that on every push, twice over. It generates everything twice and diffs the two, and it runs docs --check over every published results directory so that a file somebody edited by hand fails the build rather than being quietly overwritten by the next sweep.
The exit gate was run rather than asserted. All 154 charts drawn, all three documents generated, then every image reference pulled out of the three documents and diffed against the directory listing. 154 references, 154 files, no diff in either direction. Deleting a chart produces documents that name it as not drawn and link to it from nowhere.
Still nothing measured. The runner is M5.
What is in it
cache-bench docs, which writesLINEAR.md,LOGARITHMIC.mdand the resultsREADME.md.results/<host>/host.json, the record of what a results directory was measured on, with nothing in it that names the machine.- The divergences table and the caveat, generated into the README rather than kept in a document nobody following a chart link will open.
- A
generatedjob in CI that catches both a non deterministic generator and a generated file somebody edited.
Four new divergences from the original, D16 through D19, all written up in divergences.md.