Repository navigation
Releases: lexmount/Lexbench-Headless-Browser
Release list
Complete run logs, 2026-08-12/13
First public release of Lexbench-Headless-Browser.
Four locally pinned engines over 1,928 tasks, run four_engine_full_20260812, bench 2026.08.02-v0_4.1, seed official20260709, k=3, 23,136 result rows: Chrome 99.90%, Moli 80.71%, Lightpanda 43.83%, Obscura 39.52%. Resource figures come from a separate A/B-calibrated round on a 557-task subset. The Kitesurf remote-endpoint lane is on the kitesurf-eval branch.
Evidence assets
Each evidence-* archive holds one run's results.jsonl, host_telemetry.jsonl and scorecard.md. Each artifacts-* archive holds that run's per-attempt protocol logs, so a third party can audit an individual failure rather than only the result row.
| Asset | Contents |
|---|---|
evidence-four_engine_full_20260812.tar.gz |
23,136 result rows, host telemetry, scorecard |
evidence-resource_baseline_20260812.tar.gz |
11,140 rows, profiler off |
evidence-resource_engine_20260812.tar.gz |
11,140 rows, profiler on, plus the generated resource card |
artifacts-four_engine_full_20260812.tar.gz |
133,882 per-attempt artifact files |
artifacts-resource_baseline_20260812.tar.gz |
59,366 files |
artifacts-resource_engine_20260812.tar.gz |
70,505 files |
evidence-kitesurf_lane_20260813.tar.gz |
All 49 rounds of the Kitesurf lane |
artifacts-kitesurf_lane_20260813.tar.gz |
4,989 per-attempt protocol artifacts |
Digests for every asset are indexed in docs/EVIDENCE.md, and the Kitesurf pair in the same file on the kitesurf-eval branch. The small machine-readable fingerprints (run_manifest.json, scores.json, resource_summary.json, host_summary.json, cold_start.jsonl) ship inside the repository under docs/evidence/, so a clone can trace a published number without downloading anything.
Both published reports regenerate byte-identically from these archives. Machine-local details, the checkout path and the fixture origin a round was served from, are rewritten to placeholders by tools/scrub_release_paths.py before packaging; nothing in the fingerprint chain is altered.