Skip to content

fix(router): tools routing now checks availability before capability …#20

Merged
growlf merged 1 commit into
mainfrom
fix/llm-router-tools-availability
May 12, 2026
Merged

fix(router): tools routing now checks availability before capability …#20
growlf merged 1 commit into
mainfrom
fix/llm-router-tools-availability

Conversation

@growlf
Copy link
Copy Markdown
Owner

@growlf growlf commented May 12, 2026

…inference

Both tools fallback paths previously routed to models inferred as capable by family name, without checking if they were actually installed in Olla.

  • scripting→tools block: add is_available() check alongside supports_tools()
  • tools-fallback block: replace hardcoded qwen2.5:14b with best_tools_model()

best_tools_model() already verifies both tools support AND availability, making the fallback chain tools-aware rather than topology-blind.

Summary

Type of change

  • Bug fix
  • New feature / enhancement
  • Documentation update
  • Refactor / cleanup
  • CI / tooling change

Related issues

Testing

  • docker compose config passes with no errors
  • Shell scripts pass shellcheck
  • Manually tested on Intel Arc hardware (if relevant)

Checklist

  • My changes follow the project's code style
  • I have updated documentation where necessary
  • I have not committed secrets or real credentials
  • .env.example is up to date (if env vars were added/removed)

…inference

Both tools fallback paths previously routed to models inferred as capable
by family name, without checking if they were actually installed in Olla.

- scripting→tools block: add is_available() check alongside supports_tools()
- tools-fallback block: replace hardcoded qwen2.5:14b with best_tools_model()

best_tools_model() already verifies both tools support AND availability,
making the fallback chain tools-aware rather than topology-blind.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@growlf growlf self-assigned this May 12, 2026
@growlf growlf merged commit f117b1c into main May 12, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant