Skip to content

Benchmark records 2026-11-10: nexo against Claude Code

Choose a tag to compare

@Locotir Locotir released this 10 Nov 14:16

Raw records of the pre-registered benchmark of 2026-11-10: nexo bf57ed4 against Claude Code 2.1.322, both on claude-sonnet-5-5, 5 tasks, 3 runs each (30 runs), plus the three pilots.

Files:

  • nexo-bench-20261110.tar.zst: transcripts, token logs, proxy logs, produced files, hidden checks, the rig and the scoring tools. The home path of the test machine is replaced (see REDACTIONS.md inside). Its SHA-256 was published in RESULTS.md before this release.
  • vote-map-20261110.json: which side of each clip was which arm. Its SHA-256 was published in RESULTS.md before anyone looked at the clips.
  • author-blind-read-20261110.txt: the one code entered. No public vote was held; see RESULTS.md.
  • SHA256SUMS

This is not a build of nexo. The install scripts keep reading the latest build- release.

nexo is an independent project. It is not affiliated with or endorsed by Anthropic.