Context length GUI / meter per conversation

[jxs714]

Hey guys,

I think it would be super helpful if we can enable a meter for viewing the context length that is left in a conversation before the chat expires. It will allow users to mentally prepare and finalize current chat to follow-up on the conversation in a new chat and continue where you left off.

[Classic298]

can be implemented as a filter plugin, and many have done that already check here: openwebui.com in the community there are multiple to choose from

[Classic298]

@jxs714 did you enable the filter AND globally enable it (so to ensure its enabled ofr all models)?

[jxs714]

@jxs714 did you enable the filter AND globally enable it (so to ensure its enabled for all models)?

Yep. I tried the following:

• Enabling it globally and per model
• Using default options they have setup when you enable it, and also manually configuring the filter options to display and enable features
• I enabled only the filter mentioned and disabled the others in the system to make sure there weren't any conflicts, even deleted other filters.

I do not see anything at all in the chat window with this filter. Its weird. I've used other filters like another one that shows tokens per sec (unfortunately the one i used didn't have context length counter) and it worked fine. This specific filter I could not get to work unless there is another setting somewhere im not aware of. I tried it on version 7 and 8

[Classic298]

let me find one

[Classic298]

ok the one you found above works but it's weird to set up.

Maybe i will publish my own version

but for now i found this one which you can also try.

https://openwebui.com/posts/token_usage_display_a94ea72f

[jxs714]

Thanks so much. I found this one right after you mentioned it in your first message but haven't tried it yet. Will try this one as well and reach back