Skip to content

Added custom endpoint for bedrock provider - #441

Closed
billsanto wants to merge 1 commit into
tidyverse:mainfrom
billsanto:bedrock-custom-endpoint
Closed

Added custom endpoint for bedrock provider#441
billsanto wants to merge 1 commit into
tidyverse:mainfrom
billsanto:bedrock-custom-endpoint

Conversation

@billsanto

Copy link
Copy Markdown
Contributor

My university uses a proxy to access AWS with its own domain name. Using provider-azure as an example, I added an "endpoint" parameter to the chat function, which, if non-empty, replaces the standard amazonaws.com URL. Anything that precedes the /model/ segment of the URL would be used for endpoint parameter in chat_aws_bedrock(). We don't include region in the URL, but if others do, then they would want to embed the region into the endpoint argument.

@billsanto

Copy link
Copy Markdown
Contributor Author

I'd like to add that we now have Bedrock in production and it would be convenient for our R researchers to have Ellmer support, since not everyone has the skills to use Python. Will it be possible to consider this anytime in the near future?

@hadley

hadley commented Jul 17, 2025

Copy link
Copy Markdown
Member

Sure, but could you call the argument base_url to match all the other chat functions?

@hadley hadley added this to the 0.3.0 milestone Jul 17, 2025
Comment thread R/provider-bedrock.R
Comment on lines +73 to +75
if (!is.null(endpoint) && nzchar(endpoint)) {
endpoint <- sub("/$", "", endpoint)
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this is necessary as req_url_path_append() will take care of any extra slashes.

Comment thread R/provider-bedrock.R
".amazonaws.com"
))
# Use custom endpoint if provided, otherwise construct default
if (nzchar(provider@base_url)) {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This default should be constructed in chat_aws_bedrock()

@hadley

hadley commented Jul 17, 2025

Copy link
Copy Markdown
Member

Hmmm, I've renamed this file since you started working on it, so it might be easier for me just to do this.

hadley added a commit that referenced this pull request Jul 17, 2025
Includes a few other miscellanous fixes since it looks like it's been a while since I ran these tests.

Replaces #441
@hadley hadley closed this Jul 17, 2025
hadley added a commit that referenced this pull request Jul 17, 2025
Includes a few other miscellanous fixes since it looks like it's been a while since I ran these tests.

Replaces #441
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants