Skip to content

Add support for streaming with Anthropic Tools #1322

@Ashton-Sidhu

Description

@Ashton-Sidhu

When using the Anthropic Agent with streaming: true, you get the error: "Anthropic does not support streaming . If you remove the code block

if (stream) {
// Anthropic does support this, but looks like it's not supported in the LITS LLM
throw new Error("Anthropic does not support streaming");
}
streaming does work fine but if you use tools, it says tools are not supported via Anthropic.

Anthropic does support streaming with tools and it would be great to get it integrated https://docs.anthropic.com/en/api/messages-streaming#streaming-request-with-tool-use

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions