Test usages and rename tools

[jrieken]

Refs: #281980

• anyOS @rwoll
• anyOS @kieferrm

Complexity: 3

Create Issue

---

We have two new built-in tools for rename and for usages. Test that

• they can be enabled/disabled via chat.tools.renameTool.enabled and chat.tools.usagesTool.enabled
• the settings are easy to find/understand and enable the tools
• the tools are picked up by the agent but only when you have the extensions installed that provide the corresponding features, e.g no rename for txt files but rename/usages for TS files. Check that the tool description spells out the supported languages
• the agent can deal with the results of these tools

[rwoll]

Starting on this now, and will report back with my findings. Thanks!

[rwoll]

tl;dr: the settings/UI pickers work as expected. When invoked, the tools work, too. However, certain models¹ are not calling them when it seems like the most efficient and effective choice and instead are falling back to grep_search and run_in_terminal.

Footnotes

1. I'll share detailed info on the models and the test cases offline, including some of the benchmarks I'm adding in response to this TPI. ↩

[kieferrm]

@jrieken the usages tool worked as expected. I had no success trying to convince any Claude model to use the rename tool.