Repository navigation
Ragent6 0.2.0
Ragent6 0.2.0 is the first public pre-1.0 score line for the deterministic local Agent benchmark.
Highlights:
- 60 local execution cases across 6 dimensions.
- Deterministic partial scoring, weighted to 100 points.
- Strict pass count retained as auxiliary x/60 evidence.
- No LLM judge and no online dependency in the benchmark core.
- Dual locale score lines under the same methodology: en-US and zh-CN.
- Locale results must not be mixed in one leaderboard.
- README and README.zh-CN both include the zh-CN reference score panel.
- The reference score panel now includes R1-R6 dimension breakdowns, each out of 10.
Validation:
- make test passed.
- en-US mock: 60/60, invalid=0.
- zh-CN mock: 60/60, invalid=0.
- release_audit.py passed for both locale manifests.
- git diff --check passed.
Manifests:
- en-US: manifests/ragent6_0_2_0_en_US.json
- zh-CN: manifests/ragent6_0_2_0_zh_CN.json