Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Amazon Bedrock support #540

Closed
austinmw opened this issue Mar 28, 2024 · 9 comments
Closed

Amazon Bedrock support #540

austinmw opened this issue Mar 28, 2024 · 9 comments

Comments

@austinmw
Copy link

Please add support for Amazon Bedrock 🤩

@jxnl
Copy link
Collaborator

jxnl commented Mar 28, 2024

I don't have any clients right now that are needing it so it's gonna have to wait unless someone contributes 😶

@jxnl
Copy link
Collaborator

jxnl commented Apr 1, 2024

now that we have

instructor.from_*, anyone is welcome to add a instructor.from_bedrock

@jarrod-dexter
Copy link

Would it be possible to implement it for Claude as I anticipate this is the primary model most of us are using via Bedrock right now? I have almost zero experience but I believe it comes down to allowing AnthropicBedrock client to be passed to the from_anthropic method:

image

Seems to be working for with this fix:

image

@jxnl
Copy link
Collaborator

jxnl commented Apr 1, 2024

sweet! ill take a PR for this

@salahaz
Copy link

salahaz commented Apr 5, 2024

any updates regarding its support ?

@shabie
Copy link

shabie commented Apr 25, 2024

Would be great to have something that works with boto3 too. I am happy to make a PR.

@fer-git
Copy link

fer-git commented May 30, 2024

+1 need this, since Anthropic announced tools feature on Bedrock.

@jxnl
Copy link
Collaborator

jxnl commented May 31, 2024

this is done, you can either do bedrock anthropic client, or use litellms's bedrock/* models

@jxnl jxnl closed this as completed May 31, 2024
@omeruth
Copy link

omeruth commented Nov 4, 2024

Is there support for Meta Models?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants