Does crush support caching of tokens?

[sergeda]

Does Crush support cashing of tokens? Without caching it will overspent a lot. I see in Gemini CLI cached tokens sometimes end up at 80%.

[kujtimiihoxha]

Crush handles caching for Anthropic endpoints and anthropic models in openrouter, other providers handle caching automatically as far as I know. If anthropic models are not being cached there might be a bug. Can you share your specific configurations so we can try to reproduce. Also some more details around the models you used and why you think caching is not working would be helpful.