Skip to content

@tanstack/ai-bedrock@0.5.0

Choose a tag to compare

@github-actions github-actions released this 09 Oct 12:39
· 235 commits to main since this release
Immutable release. Only release title and notes can be modified.
9614cc7

Minor Changes

  • #1677 f562eac - usage.promptTokens is now the total input on the Anthropic, Bedrock Converse, and Claude Code adapters. It is the uncached tokens plus the cache reads plus the cache writes. Before, it was the uncached tokens only. totalTokens now uses the new promptTokens. The cache parts stay in promptTokensDetails.cachedTokens and promptTokensDetails.cacheWriteTokens. Other adapters already report promptTokens this way.

    Breaking: if your code adds cachedTokens or cacheWriteTokens to promptTokens to get the total input, it now counts the cache two times. Use promptTokens as the total. To get the uncached tokens, subtract cachedTokens and cacheWriteTokens from promptTokens.

Patch Changes

  • #1680 377262c - Add wrapFetch to chat(), to the middleware onConfig config, and to TextOptions. A wrapper gets the next fetch and gives back a new fetch. Use it to change the URL, the headers, the request, or the response of a model call. The new FetchWrapper type names the wrapper.

    The engine chains the chat() wrapper and the middleware wrappers into one function. A middleware wrapper runs inside the chat() wrapper and applies to one model call only.

    These text adapters send their requests through the wrapper: every adapter on @tanstack/openai-base (OpenAI, the OpenAI-compatible adapters, Grok, Groq, BytePlus, LLM Gateway, Lovable, Vercel AI Gateway, Cloudflare, and the Bedrock Chat Completions and Responses APIs), Anthropic, Mistral, Ollama, and OpenRouter. The wrapper wraps the fetch of the adapter config, not the global fetch. An Anthropic or Ollama adapter with an injected client ignores wrapFetch. In Cloudflare binding mode, the wrapper runs, but the binding does not send the URL or the headers. Without wrapFetch, the requests do not change.

  • Updated dependencies [7dbfaf6, 88fd67c, 3aa2e3d, c5ae415, 13ba1b0, 377262c]:

    • @tanstack/ai@0.67.0
    • @tanstack/openai-base@0.13.0