-
-
Notifications
You must be signed in to change notification settings - Fork 40
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
sessionTokens is treated as context-window usage, but it is derived from provider usage/billing tokens.
With Anthropic web search, usage can include server-side search/tool-use work, so UI can show impossible context values
like278,000 / 200,000while chat still works. This can also cause false context-pressure behavior (for example auto-compact triggers).
To Reproduce
- Configure ECA with an Anthropic model that supports web search (for example anthropic/claude-sonnet-4-5).
- Start a new chat.
- Send a short prompt likely to trigger web search (for example “Find latest X and summarize briefly”).
- Wait for the response and check usage in chat.
- See sessionTokens jump above limit.context even though responses continue successfully.
Expected behavior
sessionTokens should not be used/displayed as strict context-window occupancy when it includes server-side usage.
Expected options:
- Separate “context tokens” vs “billing/usage tokens”.
- Do not drive context-threshold/auto-compact from a billing-oriented metric.
Also maybe - Anthropic web-search fixed charges should be reflected in cost reporting; otherwise total cost can be underreported.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working
Type
Projects
Status
Done