Use Amazon Bedrock Converse API to re-implementing Bedrock AI Models.

[maxjiang153]

see: #809

Provide a new BedrockConverseApi for AI model chat usage.
Re-implementing current chat models from AbstractBedrockApi to the Bedrock Converse API to reduce complexity.
Re-implementing Bedrock chat model usage information: #605.
Support build-in exponential backoff: #759.

things todo:

• BedrockConverseApi
• re-implement the Bedrock chat model.
• chat model exponential backoff.
• chat model options document.
• re-implement the Bedrock chat model usage information. Bedrock AI models add usage information. #605
• Tools support. AWS Bedrock models tools support #802 Add Bedrock Anthropic3 tool support. #810
• remove deprecated bedrock chat api.
• Support custom BedrockRuntimeClient and BedrockRuntimeAsyncClient.
• embedding model exponential backoff. AWS Bedrock adds exponential backoff support. #759
• Amazon Bedrock Mistral Chat model support. Add Amazon Bedrock Mistral model support. #808
• Amazon Bedrock Cohere Command R model support. AWS Bedrock add Cohere Command R model support. #667
• Amazon Bedrock Anthropic Claude 3.5 Sonnet model support. Add support for Amazon Bedrock Claude 3.5 Sonnet #914

[maxjiang153]

@tzolov Hi Christian, I'm basically finished re-implementing Bedrock AI models with the Amazon Bedrock Converse API. But there are some thing's I'd like to discuss.

1. Because of the Amazon Bedrock Converse API, bedrock chat models don't need such things as Anthropic3ChatBedrockApi anymore. Should I remove the old Apis?
2. Bedrock Mistral and Cohere Command R model which are not supported yet. Should I includes these models in this PR?

[Hakenadu]

Is it realistic to expect this PR to be merged before 1.0.0?
That would be great to see.

[DEG-7]

Is it realistic to expect this PR to be merged before 1.0.0? That would be great to see.

I hope that, I'm looking forward to have this PR merged as soon as possible too...

[maxjiang153]

I hope so, This is a huge PR, Maybe we can review it by ourselves first to reduce the workload for the team members

[maxjiang153]

Hello @tzolov Any advice on this PR?

[DEG-7]

Hi @maxjiang153, it's a pity that there is no news about this PR, maybe it's too big, I don't know....
@tzolov @markpollack any thoughts on how to move forward with this?

Thanks all for the huge effort !!

[tzolov]

Hi @maxjiang153 ,

Thank you very much for the great (and big ;) contribution.

Sorry for not reaching out earlier. We've been quite busy and lacking the manpower to review and address all PRs.

The #813 has a hight priority for me and I hope to be able to jump on it soon.

[maxjiang153]

@tzolov As Amazon Bedrock is rapidly involved and the AI 21 Jamba model is just generally available, I wonder: should I keep moving on this PR to support this new model or wait for this PR to be merged and then create a new PR to support the new model?

Check this out: https://aws.amazon.com/about-aws/whats-new/2024/06/ai21-labs-jamba-instruct-model-amazon-bedrock/

[DEG-7]

@maxjiang153 it would be great if you can update the PR with the latest changes in the project, so it can be easily reviewed by @tzolov.
Thanks to both very much !

[lameroot]

waiting ....

[maxjiang153]

@DEG-7 I see that maintaining this PR with upstream is heavy work, I'm not sure when team members will work on this PR, but I'll keep an eye out for when it will be reviewed or merged.