Replies: 3 comments
|
Thank you so much! This fixed my exact problem and now my model queries searxng perfectly. |
0 replies
|
I was losing my mind trying to get this to work. Thank you. Ironically, AI was zero help here. |
0 replies
|
Thanks a ton, spent a few hours on this. Setting the num_ctx finally got it to work. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Environment
network_mode: host)Symptoms
curlfrom inside the Open WebUI containerRoot Cause — Three Issues
1. Missing
&format=jsonin SearXNG Query URLWithout
&format=json, SearXNG returns HTML instead of JSON. Open WebUI silently fails to parse it.Verify:
Fix: In Admin Panel > Settings > Web Search, set the Query URL to:
2. Concurrent Requests set to 0 in Admin Panel
Environment variables like
RAG_WEB_SEARCH_CONCURRENT_REQUESTS=10indocker-compose.ymlare overridden by database-stored settings once you save anything in the Admin Panel. The Admin Panel value may default to0.Fix: Admin Panel > Settings > Web Search > Concurrent Requests: set to
10(or any positive number).3.
num_ctxtoo small for Agentic Function Calling (the critical one!)This is the main issue most people will miss.
Open WebUI v0.10.x changed web search to "agentic" mode — the model itself decides when to search by calling
search_webandfetch_urltools via native function calling. The tool schemas are injected into the model's context.With Ollama's default
num_ctxof 2048 tokens, there isn't enough room for the tool schemas + conversation + the model's response. The model simply can't generate the function call, so it responds without searching.Fix: In Admin Panel > Settings > Models > select your model > Advanced Params >
num_ctx (Ollama): set to 16384 (minimum 8192).This must be done per model for every model you want to use with web search.
Verification
After applying all three fixes:
Key Takeaways
num_ctxparameter is critical — tool schemas consume significant context tokens&format=jsonin the URL andjsoninsettings.ymlformatsCredits
This issue was diagnosed and resolved by Claude (Anthropic) on behalf of @Julibio, through systematic research of the Open WebUI documentation, GitHub issues, and hands-on debugging.
Related Issues
All reactions