Skip to content

Releases: lexmount/Lexbench-Headless-Browser

Complete run logs, 2026-08-12/13

Choose a tag to compare

@euyis1019 euyis1019 released this 17 Aug 21:31
6eaf0cd

First public release of Lexbench-Headless-Browser.

Four locally pinned engines over 1,928 tasks, run four_engine_full_20260812, bench 2026.08.02-v0_4.1, seed official20260709, k=3, 23,136 result rows: Chrome 99.90%, Moli 80.71%, Lightpanda 43.83%, Obscura 39.52%. Resource figures come from a separate A/B-calibrated round on a 557-task subset. The Kitesurf remote-endpoint lane is on the kitesurf-eval branch.

Evidence assets

Each evidence-* archive holds one run's results.jsonl, host_telemetry.jsonl and scorecard.md. Each artifacts-* archive holds that run's per-attempt protocol logs, so a third party can audit an individual failure rather than only the result row.

Asset Contents
evidence-four_engine_full_20260812.tar.gz 23,136 result rows, host telemetry, scorecard
evidence-resource_baseline_20260812.tar.gz 11,140 rows, profiler off
evidence-resource_engine_20260812.tar.gz 11,140 rows, profiler on, plus the generated resource card
artifacts-four_engine_full_20260812.tar.gz 133,882 per-attempt artifact files
artifacts-resource_baseline_20260812.tar.gz 59,366 files
artifacts-resource_engine_20260812.tar.gz 70,505 files
evidence-kitesurf_lane_20260813.tar.gz All 49 rounds of the Kitesurf lane
artifacts-kitesurf_lane_20260813.tar.gz 4,989 per-attempt protocol artifacts

Digests for every asset are indexed in docs/EVIDENCE.md, and the Kitesurf pair in the same file on the kitesurf-eval branch. The small machine-readable fingerprints (run_manifest.json, scores.json, resource_summary.json, host_summary.json, cold_start.jsonl) ship inside the repository under docs/evidence/, so a clone can trace a published number without downloading anything.

Both published reports regenerate byte-identically from these archives. Machine-local details, the checkout path and the fixture origin a round was served from, are rewritten to placeholders by tools/scrub_release_paths.py before packaging; nothing in the fingerprint chain is altered.