issue: Built in Tools ignore Model configuration and access ALL Knowledge Bases #21122
Replies: 3 comments 9 replies
|
🔍 Similar Issues Found I found some existing issues that might be related to this one. Please check if any of these are duplicates or contain helpful solutions:
Show 2 more related issues💡 Tips:
This comment was generated automatically by a bot. Please react with a 👍 if this comment was helpful, or a 👎 if it was not. |
Why is this expected?
As intended - that's what it's supposed to do. Not a bug. |
Uh oh!
There was an error while loading. Please reload this page.
Check Existing Issues
Installation Method
Docker
Open WebUI Version
v0.7.2 (digest: sha256:000b87a6ae726aa7f6611a0064ba528ba1a6aff6ead5fb3b6c89fd4a5717eb8a)
Ollama Version (if applicable)
No response
Operating System
Ubuntu 24.04
Browser (if applicable)
No response
Confirmation
README.md.Expected Behavior
Models respect their assigned Knowledgebases, even if Tool Calling = native and Built in Tools = true.
Only Knowledgebases that are assigned to the model can be queried by the build in tools.
Actual Behavior
The Model ignores its configuration and searches every Knowledge Base reachable by the user account, returning data it should not have access to.
Steps to Reproduce
search_knowledge_files) and correctly returns "123", proving it accessed "KB_Restricted" despite it not being configured for this Agent.Logs & Screenshots
When "Built-in Tools" is activated for a model, the model gains the ability to query Knowledge Bases. However, the scope of this query is incorrectly set to ALL Knowledge Bases the current user has access to, completely ignoring the specific Knowledge Bases configured (attached) to that model.
We have several models. Some use public hosted LLMs, some use self hosted LLMs.
The public LLMs must not have access to internal company data.
Therefore only the self hosted models use knowledge bases that contain sensitive data.
Due to this bug, even the public models gained access to the knowledge bases they where not supposed to.
This is quite a big deal!
Additional Information
No response
All reactions