Skip to content

Webstone 0.6.0

Choose a tag to compare

View all tags
@lanyue-llk lanyue-llk released this 12 Nov 04:37
· 12 commits to main since this release
v0.6.0
d0a4f0a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Webstone: the touchstone for your agent's web tools.

Browser Eval is now Webstone. This release renames the project. Scoring, datasets and results are unchanged.

Breaking changes

Before (0.5.0) Now (0.6.0)
Repository lexmount/browser-eval lexmount/webstone (old URLs redirect)
Package and command browser-eval webstone
BROWSER_EVAL_* environment variables WEBSTONE_*
Data home ~/.browser-eval ~/.webstone

Migration

git remote set-url origin https://github.com/lexmount/webstone.git
mv ~/.browser-eval ~/.webstone          # skip if you set WEBSTONE_DATA_HOME
# rename any BROWSER_EVAL_* variables in your shell or .env to WEBSTONE_*
uv sync --frozen

Evidence recorded before the rename still loads: run configs and manifests that store browser_eval_commit, HAR files written by browser-eval-cdp, and browser-eval-dataset-release/1 dataset manifests are all accepted.

Unchanged

  • Web Fetch scorer hash d0c5f12a matches 0.5.0, so Web Fetch scores compare directly with 0.5.0 runs.
  • Dataset pins: Web Fetch v2.2.0 (c12559d2), Web Search 76d9c2b6.
  • The Hugging Face dataset cards now point to Webstone. Pinned dataset revisions and manifests are unchanged.

Install

uv pip install https://github.com/lexmount/webstone/releases/download/v0.6.0/webstone-0.6.0-py3-none-any.whl
Assets 5
Loading