Skip to content

dsw-eas-full-20260818-r3

Pre-release
Pre-release

Choose a tag to compare

@qwen-code-ci-bot qwen-code-ci-bot released this 18 Aug 07:06
· 423 commits to main since this release
2af4f90

Benchmark-Qwen-Ref: v0.21.13

Full end-to-end validation: SWE-bench Verified 500, Release writeback, then Terminal-Bench 2.0 89 and final writeback.

SWE-bench Verified

  • Status: SUCCEEDED
  • Dataset: swe-bench/swe-bench-verified@2; 500/500 completed
  • Results: 351 resolved, 141 unresolved, 4 execution errors, 4 infrastructure failures
  • Score: 71.34%
  • Score denominator: valid grader results (351 + 141 = 492)
  • Qwen Code: v0.21.13 (d95901597430); model qwen3.7-plus
  • Run: pool-669a90b49d8f49e9; dispatch workflow: https://github.com/QwenLM/qwen-code/actions/runs/32109866948
  • Case trajectories: swe-bench-verified-dsw-eas-full-20260818-r3-trajectories.tar.gz (496 cases)

Terminal-Bench 2.0

  • Status: QUARANTINED
  • Dataset: terminal-bench@2.0; 89/89 completed
  • Results: 1 resolved, 37 unresolved, 36 execution errors, 15 infrastructure failures
  • Score: not published (non-scoreable or quarantined run)
  • Score denominator: valid grader results (1 + 37 = 38)
  • Qwen Code: v0.21.13 (d95901597430); model qwen3.7-plus
  • Run: pool-40646da016a146f8; dispatch workflow: https://github.com/QwenLM/qwen-code/actions/runs/32109866948
  • Case trajectories: terminal-bench-2.0-dsw-eas-full-20260818-r3-trajectories.tar.gz (44 cases)