Skip to content

dsw-eas-full-20260820-r1

Pre-release
Pre-release

Choose a tag to compare

Benchmark-Qwen-Ref: v0.21.14

Full end-to-end validation: SWE-bench Verified 500, Release writeback, then Terminal-Bench 2.0 89 and final writeback.

SWE-bench Verified

  • Status: SUCCEEDED
  • Dataset: swe-bench/swe-bench-verified@2; 500/500 completed
  • Results: 378 resolved, 116 unresolved, 3 execution errors, 3 infrastructure failures
  • Score: 76.52%
  • Score denominator: valid grader results (378 + 116 = 494)
  • Qwen Code: v0.21.14 (6e20a58923b0); model qwen3.7-plus
  • Run: pool-e790f9f02eca4d45; dispatch workflow: https://github.com/QwenLM/qwen-code/actions/runs/32280371805
  • Case trajectories: swe-bench-verified-dsw-eas-full-20260820-r1-trajectories.tar.gz (498 cases)

Terminal-Bench 2.0

  • Status: QUARANTINED
  • Dataset: terminal-bench@2.0; 89/89 completed
  • Results: 42 resolved, 31 unresolved, 11 execution errors, 5 infrastructure failures
  • Score: not published (non-scoreable or quarantined run)
  • Score denominator: valid grader results (42 + 31 = 73)
  • Qwen Code: v0.21.14 (6e20a58923b0); model qwen3.7-plus
  • Run: pool-f4f96cf4acfe4142; dispatch workflow: https://github.com/QwenLM/qwen-code/actions/runs/32280371805
  • Case trajectories: terminal-bench-2.0-dsw-eas-full-20260820-r1-trajectories.tar.gz (78 cases)