Skip to content

v0.1.0

Choose a tag to compare

View all tags
@Luolc Luolc released this 26 Jul 03:11
v0.1.0
32a17f5
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

First public release of swe-lab — tooling to build, run, and evaluate SWE-agent evaluation data (SWE-Bench Pro).

  • A sandboxed-task engine with pluggable harness / dataset / eval-method axes; rollout and eval are two compositions of one engine.
  • Two backends behind one Sandbox: A-host (Docker) and A-ghjob (the CI job is the container).
  • CLI: swe-lab {eval,rollout,verify}.

Alpha — APIs may change.

Assets 2
Loading