Show and tell: public editing becnhmark

[alexshpunt]

Hi! I've been messing around lately with my own benchmark for checking how tooling and harness affect agent's ability to make text edits. The tasks are explicitly clearly prompted and their complexity is only defined by the size of the files to edit and similar context around the edit location, that's why it's pretty suitable and interesting to check with low reasoning models. It's designed to be community based, so if anybody wants to share data feel free to do so, I've tried to cover as much as my subscriptions, tooling and time allow, but it's impossible to make runs all over and over again for the whole matrix. Mimo-2.5 is included among the models, but it would be great if somebody can test how well it behaves with the native harness, as well as bigger and multimodal models from Xiaomi family.

Viewer: https://huggingface.co/spaces/alexshpunt/benchmark-explorer
Repo: https://github.com/alexshpunt/explicit-edit-benchmark