Skip to content

Support for AWS Bedrock BidirectionalStream #4455

@jonathannaguin

Description

@jonathannaguin

Expected Behavior

The Amazon Nova Sonic model uses the InvokeModelWithBidirectionalStream API, which enables real-time bidirectional streaming conversations. This differs from traditional request-response patterns by maintaining an open channel for continuous audio streaming in both directions.

Current Behavior

This interface is not available today, we can use Converse and ConverseStream but not the bidirectional API.

Context

This is required for using new models available for speech to speech interaction patterns.

https://docs.aws.amazon.com/nova/latest/userguide/speech.html
https://docs.aws.amazon.com/nova/latest/userguide/speech-bidirection.html

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions