Skip to content

browseruse-bench v1.0.0

Latest
Latest

Choose a tag to compare

View all tags
@Julia-Lex Julia-Lex released this 11 May 10:41
· 89 commits to main since this release
v1.0.0
313b0cf
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Initial public benchmark snapshot for LexBench-Browser.

Highlights:

  • LexBench-Browser v1.0 with 210 public tasks across 107 real websites.
  • Multi-benchmark runner support for LexBench-Browser, Online-Mind2Web, and BrowseComp.
  • Reference integrations for browser-use, skyvern, Agent-TARS, and deepbrowse.
  • Local leaderboard, trajectory visualization, and cost/latency/token metrics.
  • Reproducible Agent x Model x Browser x Eval configuration through the bubench CLI.

Use this release as the stable citation and reproduction anchor for the initial public benchmark.

Assets 2
Loading