Skip to content

The Clinic's run records, data-v4 (Gemma and Haiku cb1 cells, adds to data-v2 and data-v3)

Choose a tag to compare

View all tags
@kltownsend kltownsend released this 13 Nov 01:07
· 2 commits to main since this release
data-v4
de0f0a9

The Clinic's run records (data-v4)

The eight Gemma and Haiku cells with the cb1 examples on doctor and schedule. Lab 030, Examples aren't portable. Validate them per model., compares them with the hosted readers, but they weren't in an earlier release. Released by Keith Townsend, The CTO Advisor, on 2026-11-12.

What's new

data-v4 adds eight cells. With it, every cell Lab 030 compares is public:

  • data-v2: Lab 029's 28 cells, including Gemma's and Haiku's cb1 payment cells.
  • data-v3: the 18 Jev and Bivia cells.
  • data-v4: these eight.

The eight:

  • Gemma 4 26B with cb1, arms E and F, on doctor and schedule. 4 cells, run on two DGX Sparks in October 2026.
  • Claude Haiku 5.5 with cb1, thinking off, arms E and F, on doctor and schedule. 4 cells, run through Anthropic's API in October 2026.

Each is 48,000 conversations on the same frozen bench (instrument hash 0f3e1c09488db424), with no infrastructure failures left. The cb1 examples are Lab 024's six labeled cases per question, with one relabel, given in the prompt.

These cells were recorded and pinned in October. They're released as recorded: each archive's session set matches the hash the Clinic's source manifest pinned then.

What's here

  • One archive per cell, <cell id>.tar.gz, 8 in all, the same layout as data-v2 and data-v3: <id>/sessions/*.json, <id>/summary.json and <id>/cell.json, cleaned of machine addresses.
  • MANIFEST.json: every archive's SHA-256, its variants, its session count, and the pinned session-set hash.

Check a download with:

shasum -a 256 <cell id>.tar.gz

and compare it with the cell's entry in MANIFEST.json.

What the records are, and aren't

  • The patients are synthetic. No real patient or health data is in any record.
  • Each cell is one run of its reader. Run-to-run variation isn't in any interval.
  • Gemma's doctor cells were stopped and resumed. Both servers were stopped mid-run on 2026-10-27 and resumed on the same pinned servers. Every conversation has a valid record, and each cell's note says so.
  • Two known defects are in the patient lines, left in by ruling. A clear refusal can name the slot just offered without saying what was refused, and a contradictory disclosure sounds like a clean correction.

Disclosure

Google Cloud is a client of The CTO Advisor, and Gemma is a Google model. No vendor reviewed these records.

Assets 11
Loading