From 0ad099852f7de298a7697273faf5426cb5e1da48 Mon Sep 17 00:00:00 2001 From: Silvio Vasiljevic Date: Wed, 4 Dec 2024 12:35:55 +0100 Subject: [PATCH] Add troubleshooting section to Bedrock and adapt default model --- content/en/references/configuration.md | 2 +- content/en/user-guide/aws/bedrock/index.md | 10 ++++++++++ 2 files changed, 11 insertions(+), 1 deletion(-) diff --git a/content/en/references/configuration.md b/content/en/references/configuration.md index 42ecd39e4e..8ea82883de 100644 --- a/content/en/references/configuration.md +++ b/content/en/references/configuration.md @@ -95,7 +95,7 @@ This section covers configuration options that are specific to certain AWS servi | Variable | Example Values | Description | | - | - | - | | `BEDROCK_PREWARM` | `0` (default) \| `1` | Pre-warm the Bedrock engine directly on LocalStack startup instead of on demand. | -| `DEFAULT_BEDROCK_MODEL` | `mistral` (default) | The model to use to handle text model invocations in Bedrock. Any text-based model available for Ollama is usable. | +| `DEFAULT_BEDROCK_MODEL` | `smollm2` (default) | The model to use to handle text model invocations in Bedrock. Any text-based model available for Ollama is usable. | ### BigData (EMR, Athena, Glue) diff --git a/content/en/user-guide/aws/bedrock/index.md b/content/en/user-guide/aws/bedrock/index.md index 530b8f90c1..efa0bbfea1 100644 --- a/content/en/user-guide/aws/bedrock/index.md +++ b/content/en/user-guide/aws/bedrock/index.md @@ -127,6 +127,16 @@ $ awslocal bedrock create-model-invocation-job \ The results will be at the S3 URL `s3://out-bucket/12345678/batch_input.jsonl.out` +## Troubleshooting + +Users of Docker Desktop on macOS might run into the issue of Bedrock becoming unresponsive after some usage. +A common reason for that is insufficient storage or memory space in the Docker Desktop VM. +To resolve this issue you can increase those amounts directly in Docker Desktop or clean up unused artifacts with the Docker CLI like this + +{{< command >}} +$ docker system prune +{{< / command >}} + ## Limitations * At this point, we have only tested text-based models in LocalStack.