Skip to content

Platform: Add Amazon Bedrock offerings to available enrichment providers and models #460

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jan 31, 2025
Merged

Platform: Add Amazon Bedrock offerings to available enrichment providers and models #460

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 15 additions & 11 deletions platform/summarizing.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,11 @@ title: Summarizing
---

After partitioning and chunking, _summarizing_ generates text-based summaries of images and tables.
This summarization is done by using the [GPT-4o](https://openai.com/index/hello-gpt-4o/) or
[Claude 3.5 Sonnet](https://www.anthropic.com/news/claude-3-5-sonnet) models.
This summarization is done by using models offered through these providers:

- [GPT-4o](https://openai.com/index/hello-gpt-4o/), provided through OpenAI.
- [Claude 3.5 Sonnet](https://www.anthropic.com/news/claude-3-5-sonnet), provided through Anthropic.
- [Claude 3.5 Sonnet](https://aws.amazon.com/bedrock/claude/), provided through Amazon Bedrock.

Here is an example of the output of image summarization using GPT-4o. Note specifically the `text` field that is added.
Line breaks have been inserted here for readability. The output will not contain these line breaks.
Expand Down Expand Up @@ -68,19 +71,20 @@ Line breaks have been inserted here for readability. The output will not contain
}
```

## Summarize images and tables
## Summarize images or tables

To summarize images and tables, in the **Enrichment model** section of an **Enrichment** node in a workflow, specify the following:
To summarize images or tables, in the **Task** drop-down list of an **Enrichment** node in a workflow, specify the following:

<Note>You can change a workflow's summarization settings only through [Custom](/platform/workflows#create-a-custom-workflow) workflow settings.</Note>

For image summarization, choose one of the following:
For image summarization, select **Image Description**, and then choose one of the following provider (and model) combinations to use:

- **OpenAI Image Description**: Use GPT-4o to summarize images. [Learn more](https://openai.com/index/hello-gpt-4o/).
- **Anthropic Image Description**: Use Claude 3.5 Sonnet to summarize images. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet).
- **OpenAI (GPT-4o)**. [Learn more](https://openai.com/index/hello-gpt-4o/).
- **Anthropic (Claude 3.5 Sonnet)**. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet).
- **Amazon Bedrock (Claude 3.5 Sonnet)**. [Learn more](https://aws.amazon.com/bedrock/claude/).

For table summarization, choose one of the following:
For table summarization, select **Table Description**, and then choose one of the following provider (and model) combinations to use:

- **OpenAI GPT-4o Table Description**: Use GPT-4o to summarize tables. [Learn more](https://openai.com/index/hello-gpt-4o/).
- **OpenAI GPT-4o Table to HTML**: Use GPT-4o to convert tables to HTML format. [Learn more](https://openai.com/index/hello-gpt-4o/).
- **Anthropic Table Description**: Use Claude 3.5 Sonnet to summarize tables. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet).
- **OpenAI (GPT-4o)**. [Learn more](https://openai.com/index/hello-gpt-4o/).
- **Anthropic (Claude 3.5 Sonnet)**. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet).
- **Amazon Bedrock (Claude 3.5 Sonnet)**. [Learn more](https://aws.amazon.com/bedrock/claude/).
27 changes: 20 additions & 7 deletions platform/workflows.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -321,15 +321,28 @@ To create an automatic workflow:

</Accordion>
<Accordion title="Enrichment node">
For **Enrichment model**, choose one of the following:
For **Task**, choose one of the following:

- **Image Description** to summarize images. Also select one of the following provider (and model) combinations to use:

- **OpenAI (GPT-4o)**. [Learn more](https://openai.com/index/hello-gpt-4o/).
- **Anthropic (Claude 3.5 Sonnet)**. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet).
- **Amazon Bedrock (Claude 3.5 Sonnet)**. [Learn more](https://aws.amazon.com/bedrock/claude/).

[Learn more](/platform/summarizing).

- **OpenAI Image Description** to use GPT-4o to summarize images. [Learn more](https://openai.com/index/hello-gpt-4o/).
- **OpenAI Table Description** to use se GPT-4o to summarize tables. [Learn more](https://openai.com/index/hello-gpt-4o/).
- **OpenAI Table to HTML** to use GPT-4o to convert tables to HTML. [Learn more](https://openai.com/index/hello-gpt-4o/).
- **Anthropic Image Description** to use Claude 3.5 Sonnet to summarize images. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet).
- **Anthropic Table Description** to use Claude 3.5 Sonnet to summarize tables. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet).
- **Table Description** to summarize tables. Also select one of the following provider (and model) combinations to use:

- **OpenAI (GPT-4o)**. [Learn more](https://openai.com/index/hello-gpt-4o/).
- **Anthropic (Claude 3.5 Sonnet)**. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet).
- **Amazon Bedrock (Claude 3.5 Sonnet)**. [Learn more](https://aws.amazon.com/bedrock/claude/).

[Learn more](/platform/summarizing).
[Learn more](/platform/summarizing).

- **Table to HTML** to convert tables to HTML. Also select one of the following provider (and model) combinations to use:

- **OpenAI (GPT-4o)**. [Learn more](https://openai.com/index/hello-gpt-4o/).

</Accordion>
<Accordion title="Embedder node">
For **Select Embedding Model**, select one of the following:
Expand Down