Replies: 1 comment 4 replies
-
|
Are you using OpenAI API or Ollama? Because the answer to this question is that it's likely an ollama only feature that wasn't properly marked as such. |
Beta Was this translation helpful? Give feedback.
4 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Check Existing Issues
Installation Method
Docker
Open WebUI Version
v0.5.20
Ollama Version (if applicable)
No response
Operating System
Windows 10
Browser (if applicable)
No response
Confirmation
README.md.Expected Behavior
When setting "Tokens To Keep On Context Refresh (num_keep)" to 1, the model should retain only 1 token from previous messages. If asked to recall earlier information, it should not remember details beyond this limit.
Actual Behavior
Despite setting "Tokens To Keep On Context Refresh (num_keep)" to 1, the model retains more than 1 token and successfully recalls information from previous messages.
Steps to Reproduce
Unexpected Behavior:
The model still remembers the name, indicating that more than 1 token is retained, despite the setting.
Logs & Screenshots
Additional Information
No response
Beta Was this translation helpful? Give feedback.
All reactions