Bedrock Prompt Caching doesn't broke since version 3.13.0

[ronyblum]

App Version

3.15.0

API Provider

Amazon Bedrock

Model Used

Claude 3.7 Sonnet

Actual vs. Expected Behavior

Since version 3.13.0, no tokens are sent to Bedrock Prompt Caching or read from there

Detailed Steps to Reproduce

1. Enable Prompt Caching using Claude 3.7 Sonnet in Bedrock
2. Run a simple query or task
3. Identify no tokens are sent or read from Caching. Can be seen in the stats in Roo or Bedrock invocation token counts

Relevant API Request Output

Additional Context

No response

[dosubot]

Hello @ronyblum! I'm here to help you with any bugs, questions, or contributions you might have while we wait for a human maintainer. Let’s get started!

A similar issue was discussed in this thread, but it remains unsolved ^[1]. Additionally, prompt caching issues with OpenRouter Claude models were addressed in version 3.7.2, where a fix was implemented for prompt caching with OpenRouter's anthropic/claude-3.7-sonnet:beta ^[2]. If you are experiencing issues with prompt caching in version 3.15.0, it might be worth checking if similar fixes have been applied or if there are any updates related to Amazon Bedrock in the release notes.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}

[ronyblum]

The mechanism in v3.15.0 uses MultiPointStrategy which is by design