Extract shared load_llm_config utility

[simonrosenberg]

Summary

• Extracts the duplicated inline LLM config loading pattern (read file, validate, return LLM) into a shared load_llm_config() helper in benchmarks/utils/llm_config.py
• Updates all 7 run_infer.py files to use the shared helper, removing ~5 lines of boilerplate from each

Test plan

• Verify imports resolve correctly in CI
• Run any benchmark inference to confirm LLM config loading still works

🤖 Generated with Claude Code

[simonrosenberg]

@OpenHands resolve conflicts

[openhands-ai]

I'm on it! simonrosenberg can track my progress at all-hands.dev

[all-hands-bot]

🟡 Acceptable - Good refactoring that eliminates real duplication, but missing test coverage for a critical shared utility.

[openhands-ai]

Summary

I resolved the merge conflicts in PR #453 as requested.

What was done:

1. Fetched and merged main into the llm-config-util branch

2. Resolved conflicts in 5 files where the SDK imports conflicted:

   • benchmarks/commit0/run_infer.py
   • benchmarks/multiswebench/run_infer.py
   • benchmarks/openagentsafety/run_infer.py
   • benchmarks/swebench/run_infer.py
   • benchmarks/swtbench/run_infer.py

3. Conflict resolution strategy:

   • main added Tool to the imports (new feature)
   • llm-config-util removed LLM from imports (since it's loaded via load_llm_config helper)
   • Solution: Keep Tool import from main, preserve removal of LLM import

4. Verified changes with pre-commit checks (ruff format, ruff lint, pycodestyle, pyright) - all passed

5. Pushed the merge commit to update the PR

Checklist:

• ✅ Conflicts resolved
• ✅ Pre-commit checks pass
• ✅ Changes pushed to origin/llm-config-util
• ✅ No extraneous changes (only conflict resolution + auto-fixes from ruff)

[all-hands-bot]

🟡 Acceptable - Solid refactoring that eliminates real duplication. Simple, focused function with good test coverage. One critical encoding bug must be fixed before merging.

[all-hands-bot]

✅ Excellent refactoring. Previous issues (encoding, test coverage) are fully resolved. The utility is simple, well-tested with real code paths, and eliminates actual duplication across 7 files. This is what good refactoring looks like - no issues found.