Skip to content

fix(ai): normalize Bedrock cache usage#38427

Merged
rekram1-node merged 2 commits into
v2from
bedrock-cache-usage
Jul 23, 2026
Merged

fix(ai): normalize Bedrock cache usage#38427
rekram1-node merged 2 commits into
v2from
bedrock-cache-usage

Conversation

@opencode-agent

@opencode-agent opencode-agent Bot commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Summary

  • treat Bedrock Converse inputTokens as non-cached input, matching AWS prompt-caching semantics
  • derive normalized inclusive input usage by summing non-cached, cache-read, and cache-write tokens
  • update usage contract documentation and cover the mapping with focused synthetic and recorded event-stream tests
  • record a real bearer-authenticated cache write followed by a cache read, asserting the normalized usage invariant on replay

AWS reference: https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html

Checks

  • bun test test/provider/bedrock-converse.test.ts test/provider/bedrock-converse-cache.recorded.test.ts (34 passed)
  • bun typecheck
  • bun x prettier --check packages/ai/src/protocols/bedrock-converse.ts packages/ai/src/schema/events.ts packages/ai/test/provider/bedrock-converse.test.ts packages/ai/test/provider/bedrock-converse-cache.recorded.test.ts
  • cassette verified to contain neither the authorization header nor bearer token

Requested by: @rekram1-node (Aiden Cline via Slack)

@rekram1-node
rekram1-node merged commit 6e8aefc into v2 Jul 23, 2026
10 checks passed
@rekram1-node
rekram1-node deleted the bedrock-cache-usage branch July 23, 2026 02:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant