Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Add Bedrock integration to support Amazon Titan, Jurassic AI, Anthropic's Models via AWS Account #1156

Open
Vrandus opened this issue Jan 26, 2024 · 7 comments

Comments

@Vrandus
Copy link

Vrandus commented Jan 26, 2024

Problem Description
Please describe the issue or difficulty you are experiencing and why it makes using the software difficult or frustrating.

  • No support for AWS Bedrock's models (AWS Titan, Jurassic AI)
  • No support to use AWS credentials to interface with Anthropic's Claude Model

Proposed Solution
Please provide a clear and concise description of what you would like to see in terms of a function or solution.

  • Add support for AWS Bedrock Models, enabling Amazon Titan, Anthropic and Jurassic AI models (and future models) to be able to be used in ChatBox
  • Use AWS credentials to make calls into bedrock hosted models
  • Use AWS Bedrock's unified SDK to add enable all models above at once

Additional Context
Please provide any additional context or information that would help better understanding your feature request, such as screenshots, examples, or use cases.

@Vrandus Vrandus changed the title [Feature] [Feature] Add Bedrock integration to support Amazon Titan, Jurassic AI, Anthropic's Models via AWS Account Jan 26, 2024
@0x5c0f
Copy link

0x5c0f commented Apr 12, 2024

需求 +1
Request +1

@stirredo
Copy link

Clause Opus is now available on AWS bedrock. Please add support for AWS bedrock.

@dannysteenman
Copy link

+1

@myoss
Copy link

myoss commented Apr 18, 2024

@geekyayush
Copy link

+1 for claude via bedrock please

@xiao2c
Copy link

xiao2c commented Aug 4, 2024

+1, now we can use claude 3.5 sonnet if enable AWS. And many other open source models.

@rizkyarlin
Copy link

https://github.com/aws-samples/bedrock-access-gateway

While waiting for it to be integrated natively, We can try running this gateway locally with docker. It will then expose OpenAI-compatible API.

For reference: https://gauravve.medium.com/connecting-open-webui-to-aws-bedrock-a1f0082c8cb2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants