From d1e5de1b6a74aa2633258cf66643f8470908bee8 Mon Sep 17 00:00:00 2001 From: Taras Yemets Date: Thu, 12 Dec 2024 12:00:52 +0200 Subject: [PATCH 1/2] Update Amazon Bedrock auth --- .../enterprise/completions-configuration.mdx | 16 +++++++++++++--- 1 file changed, 13 insertions(+), 3 deletions(-) diff --git a/docs/cody/enterprise/completions-configuration.mdx b/docs/cody/enterprise/completions-configuration.mdx index d543437d9..1d0f7ea56 100644 --- a/docs/cody/enterprise/completions-configuration.mdx +++ b/docs/cody/enterprise/completions-configuration.mdx @@ -87,9 +87,19 @@ For `endpoint`, you can either: For `accessToken`, you can either: -- Leave it empty and rely on instance role bindings or other AWS configurations in the `frontend` service -- Set it to `:` if directly configuring the credentials -- Set it to `::` if a session token is also required +- Leave it empty and rely on instance role bindings or other AWS configurations in the `frontend` service +- Set it to `:` if directly configuring the credentials +- Set it to `::` if a session token is also required + + + We only recommend configuring AWS Bedrock to use an accessToken for + authentication. Specifying no accessToken (e.g. to use [IAM roles for EC2 / + instance role + binding](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/iam-roles-for-amazon-ec2.html)) + is not currently recommended (there is a known performance bug with this + method which will prevent autocomplete from working correctly. (internal + issue: PRIME-662) + ### Example: Using GCP Vertex AI From ec1ba5cd92353cf81fb69a43d09b0ac025297290 Mon Sep 17 00:00:00 2001 From: Taras Yemets Date: Thu, 12 Dec 2024 12:06:48 +0200 Subject: [PATCH 2/2] add note on bedrock auth to model config examples --- docs/cody/enterprise/model-config-examples.mdx | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/docs/cody/enterprise/model-config-examples.mdx b/docs/cody/enterprise/model-config-examples.mdx index 8ac77a72f..3276aeda5 100644 --- a/docs/cody/enterprise/model-config-examples.mdx +++ b/docs/cody/enterprise/model-config-examples.mdx @@ -682,4 +682,14 @@ Provider override `serverSideConfig` fields: Provisioned throughput for Amazon Bedrock models can be configured using the `"awsBedrockProvisionedThroughput"` server-side configuration type. Refer to the [Model Overrides](/cody/enterprise/model-configuration#model-overrides) section for more details. + + We only recommend configuring AWS Bedrock to use an accessToken for + authentication. Specifying no accessToken (e.g. to use [IAM roles for EC2 / + instance role + binding](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/iam-roles-for-amazon-ec2.html)) + is not currently recommended (there is a known performance bug with this + method which will prevent autocomplete from working correctly. (internal + issue: PRIME-662) + +