Cache read write token counts

[srinivasanmohan98-dotcom]

Currently the adk ignores the cache read write token counts provided by litellm bedrock model and i can only see the cached content token count(cached tokens read) due to which the cache read write token cost calculation is not made correctly in arize. Could anyone please help me on this?

[sanketpatil06]

Hi @srinivasanmohan98-dotcom, Could you please provide a minimal reproduction code? This will help us understand the issue effectively. Also, please share the ADK version you are currently using. Thanks.

[srinivasanmohan98-dotcom]

Hi @sanketpatil06 I use the Google adk instrumentor to export the traces. I can't share the code now but what I understood is the adk doesn't capture the usage metadata fully like cache write and read from the litellm output. It only holds the cached content token count which seems to be the cache read token counts. But I need the cache write token count as well. Please refer the image I attached here.

[srinivasanmohan98-dotcom]

I use adk 1.28

[enesdemirag]

I have a question, does adk caches session message history automatically when using run_async with vertexai session manager?