Skip to content

Re-implement token caching for Vercel AI SDK usage. #58

@bhouston

Description

@bhouston

We used to have token caching implemented for the Anthropic SDK when using it directly but now that we are moving towards the Vercel AI SDK, we need to re-implement token caching using the Vercel AI SDK method. The way to do it is specific per AI provider, so the Anthropic way is described here: https://sdk.vercel.ai/providers/ai-sdk-providers/anthropic

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions