MoveBench — 80-question public benchmark

Current public benchmark: 80 questions

This release contains 80 Chinese questions: 50 open-ended, 11 single-select, and 19 multi-select. Domain distribution: PG 26, DA 29, QA 25. The attached files are the questions-only model input and matching answer submission template.

• Submission guide
• Dataset on Hugging Face
• Leaderboard

The paper reports results on the full 809-question benchmark; those scores cannot be treated as results for this 80-question public subset.

Historical release — superseded by the 80-question benchmark

Historical release — use the current 80-question release

This tag and its attached files preserve the earlier 140-question dataset for historical reference. They are not compatible with the current 80-question submission template. Please use the current release, the current main branch, and the submission guide.

Historical versions and copies remain accessible. The paper's 809-question benchmark is distinct from the current 80-question public subset.