Skip to content

Ragent6 0.2.0

Choose a tag to compare

@weicj weicj released this 02 May 05:19
· 3 commits to main since this release

Ragent6 0.2.0 is the first public pre-1.0 score line for the deterministic local Agent benchmark.

Highlights:

  • 60 local execution cases across 6 dimensions.
  • Deterministic partial scoring, weighted to 100 points.
  • Strict pass count retained as auxiliary x/60 evidence.
  • No LLM judge and no online dependency in the benchmark core.
  • Dual locale score lines under the same methodology: en-US and zh-CN.
  • Locale results must not be mixed in one leaderboard.
  • README and README.zh-CN both include the zh-CN reference score panel.
  • The reference score panel now includes R1-R6 dimension breakdowns, each out of 10.

Validation:

  • make test passed.
  • en-US mock: 60/60, invalid=0.
  • zh-CN mock: 60/60, invalid=0.
  • release_audit.py passed for both locale manifests.
  • git diff --check passed.

Manifests:

  • en-US: manifests/ragent6_0_2_0_en_US.json
  • zh-CN: manifests/ragent6_0_2_0_zh_CN.json