Skip to content

DSW EAS TB end-to-end validation r1

Pre-release
Pre-release

Choose a tag to compare

@DennisYu07 DennisYu07 released this 14 Aug 03:58
· 16 commits to main since this release
53a7f2f

Isolated end-to-end validation release.

Benchmark-Qwen-Ref: v0.21.2

SWE-bench Verified

  • Status: SUCCEEDED
  • Dataset: swe-bench/swe-bench-verified@2; 1/1 completed
  • Results: 0 resolved, 0 unresolved, 0 execution errors, 1 infrastructure failures
  • Score: not published (non-scoreable or quarantined run)
  • Score denominator: valid grader results (0 + 0 = 0)
  • Qwen Code: v0.21.2 (456fc9b02d7e); model qwen3.7-plus
  • Run: pool-e4ce2445a65e4a0f; dispatch workflow: #9120
  • Case trajectories: swe-bench-verified-dsw-eas-tb-e2e-20260814-r1-trajectories.tar.gz (0 cases)

Terminal-Bench 2.0

  • Status: QUARANTINED
  • Dataset: terminal-bench@2.0; 13/89 completed
  • Results: 0 resolved, 0 unresolved, 13 execution errors, 0 infrastructure failures
  • Score: not published (non-scoreable or quarantined run)
  • Score denominator: valid grader results (0 + 0 = 0)
  • Qwen Code: v0.21.2 (456fc9b02d7e); model qwen3.7-plus
  • Run: pool-ed04e0e980e04f87; dispatch workflow: #9120
  • Case trajectories: terminal-bench-2.0-dsw-eas-tb-e2e-20260814-r1-trajectories.tar.gz (0 cases)