Skip to content

Platform: Add Amazon Bedrock models for Embedder node #453

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Jan 30, 2025
Merged

Platform: Add Amazon Bedrock models for Embedder node #453

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
178c04a
Platform: Add Amazon Bedrock models for Embedder node
Paul-Cornell Jan 28, 2025
80d47d2
Add Bedrock embedder details to Embedding node section, too.
Paul-Cornell Jan 28, 2025
0a66967
Typo: 1024 embeddings -> 1024 dimensions
Paul-Cornell Jan 28, 2025
9297b64
Merge branch 'main' into DOCS-147-bedrock-embedder
Paul-Cornell Jan 30, 2025
81be56f
Update embedding.mdx
Paul-Cornell Jan 30, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 12 additions & 4 deletions platform/embedding.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -59,22 +59,30 @@ on Hugging Face:

## Generate embeddings

To generate embeddings, choose one of the following embedding providers and models in the **Providers** section of an **Embedder** node in a workflow:
To generate embeddings, choose one of the following embedding providers and models in the **Select Embedding Model** section of an **Embedder** node in a workflow:

<Note>You can change a workflow's preconfigured provider only through [Custom](/platform/workflows#create-a-custom-workflow) workflow settings.</Note>

- **Azure OpenAI**: Use [Azure OpenAI](https://azure.microsoft.com/products/ai-services/openai-service) to generate embeddings. Also, choose the model to use:
- **Azure OpenAI**: Use [Azure OpenAI](https://azure.microsoft.com/products/ai-services/openai-service) to generate embeddings with one of the following models:

- **text-embedding-3-small**, with 1536 dimensions.
- **text-embedding-3-large**, with 3072 dimensions.
- **Ada 002 (Text)** (`text-embedding-ada-002`), with 1536 dimensions.

[Learn more](https://learn.microsoft.com/azure/ai-services/openai/concepts/models#embeddings).

- **TogetherAI**: Use [TogetherAI](https://www.together.ai/) to generate embeddings. Also, choose the model to use:
- **Amazon Bedrock**: Use [Amazon Bedrock](https://aws.amazon.com/bedrock) to generate embeddings with one of the following models:

- **Titan Text Embeddings V2**, with 1024 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/titan-embedding-models.html).
- **Titan Embeddings G1 - Text**, with 1536 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/titan-embedding-models.html).
- **Titan Multimodal Embeddings G1**, with 1024 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/titan-multiemb-models.html).
- **Cohere Embed English**, with 1024 embeddings. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-embed.html).
- **Cohere Embed Multilingual**, with 1024 embedding. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-embed.html).

- **TogetherAI**: Use [TogetherAI](https://www.together.ai/) to generate embeddings with one of the following models:

- **M2-BERT-80M-2K-Retrieval**, with 768 dimensions.
- **M2-BERT-80M-8K-Retrieval**, with 768 dimensions.
- **M2-BERT-80M-32K-Retrieval**, with 768 dimensions.

[Learn more](https://docs.together.ai/docs/serverless-models#embedding-models).
[Learn more](https://docs.together.ai/docs/serverless-models#embedding-models).
14 changes: 11 additions & 3 deletions platform/workflows.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -332,17 +332,25 @@ To create an automatic workflow:
[Learn more](/platform/summarizing).
</Accordion>
<Accordion title="Embedder node">
For **Providers**, select one of the following:
For **Select Embedding Model**, select one of the following:

- **Azure OpenAI**: Use Azure OpenAI to generate embeddings. Also, choose the model to use:
- **Azure OpenAI**: Use Azure OpenAI to generate embeddings with one of the following models:

- **text-embedding-3-small**, with 1536 dimensions.
- **text-embedding-3-large**, with 3072 dimensions.
- **Ada 002 (Text)** (`text-embedding-ada-002`), with 1536 dimensions.

[Learn more](https://learn.microsoft.com/azure/ai-services/openai/concepts/models#embeddings).

- **TogetherAI**: Use TogetherAI to generate embeddings. Also, choose the model to use:
- **Amazon Bedrock**: Use Amazon Bedrock to generate embeddings with one of the following models:

- **Titan Text Embeddings V2**, with 1024 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/titan-embedding-models.html).
- **Titan Embeddings G1 - Text**, with 1536 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/titan-embedding-models.html).
- **Titan Multimodal Embeddings G1**, with 1024 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/titan-multiemb-models.html).
- **Cohere Embed English**, with 1024 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-embed.html).
- **Cohere Embed Multilingual**, with 1024 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-embed.html).

- **TogetherAI**: Use TogetherAI to generate embeddings with one of the following models:

- **M2-BERT-80M-2K-Retrieval**, with 768 dimensions.
- **M2-BERT-80M-8K-Retrieval**, with 768 dimensions.
Expand Down