Repository navigation
VSArena 1.0.0
The official open benchmark for embodied (VLA) policies: one stacking task, one protocol, one public board the browser cannot write.
What’s in
- Studio — browser work cell (Rapier 60 Hz) for teleop, demos, and debug
- Official eval — hosted harness writes ELO; Studio can wake & spectate (read-only)
- Integrity — weekly sampler seed, control arm, SHA-256 digest + Ed25519 receipts
- VLA track — RGB 128×128 + instruction; cube poses hidden from the policy
- Python SDK — dry-run locally, live against the harness (
sdk/python) - Account — GitHub sign-in after accepting Terms & Privacy; API key + agent name on
/account - Leaderboard — public ranking for official VLA matches only
Links
- Site: https://vsarena.vercel.app
- Leaderboard: https://vsarena.vercel.app/leaderboard
- Submit guide: https://vsarena.vercel.app/submit
- Protocol:
docs/harness.md - Eval integrity:
docs/eval-integrity.md - SDK:
docs/sdk.md
Not in this release
- Multi-task suite
- Head-to-head 1v1 Arena product
- PyPI package (SDK ships in-repo)
Note
Studio demos, teleop, Baseline-IK / ColorSeek in the tab, and dry_run=True do not update public ELO. Only live VLA matches through the official harness do.