dsw-eas-full-20260818-r3
Pre-release
Pre-release
·
423 commits
to main
since this release
Benchmark-Qwen-Ref: v0.21.13
Full end-to-end validation: SWE-bench Verified 500, Release writeback, then Terminal-Bench 2.0 89 and final writeback.
SWE-bench Verified
- Status: SUCCEEDED
- Dataset:
swe-bench/swe-bench-verified@2; 500/500 completed - Results: 351 resolved, 141 unresolved, 4 execution errors, 4 infrastructure failures
- Score: 71.34%
- Score denominator: valid grader results (351 + 141 = 492)
- Qwen Code:
v0.21.13(d95901597430); modelqwen3.7-plus - Run:
pool-669a90b49d8f49e9; dispatch workflow: https://github.com/QwenLM/qwen-code/actions/runs/32109866948 - Case trajectories:
swe-bench-verified-dsw-eas-full-20260818-r3-trajectories.tar.gz(496 cases)
Terminal-Bench 2.0
- Status: QUARANTINED
- Dataset:
terminal-bench@2.0; 89/89 completed - Results: 1 resolved, 37 unresolved, 36 execution errors, 15 infrastructure failures
- Score: not published (non-scoreable or quarantined run)
- Score denominator: valid grader results (1 + 37 = 38)
- Qwen Code:
v0.21.13(d95901597430); modelqwen3.7-plus - Run:
pool-40646da016a146f8; dispatch workflow: https://github.com/QwenLM/qwen-code/actions/runs/32109866948 - Case trajectories:
terminal-bench-2.0-dsw-eas-full-20260818-r3-trajectories.tar.gz(44 cases)