From 6d4232d1b332d1e976faf2eeffcd9e601c38b48b Mon Sep 17 00:00:00 2001 From: Paul Cornell Date: Thu, 30 Jan 2025 11:19:58 -0800 Subject: [PATCH] Platform: Add Amazon Bedrock offerings to available enrichment providers and models --- platform/summarizing.mdx | 26 +++++++++++++++----------- platform/workflows.mdx | 27 ++++++++++++++++++++------- 2 files changed, 35 insertions(+), 18 deletions(-) diff --git a/platform/summarizing.mdx b/platform/summarizing.mdx index 20e125af..bc21e7e9 100644 --- a/platform/summarizing.mdx +++ b/platform/summarizing.mdx @@ -3,8 +3,11 @@ title: Summarizing --- After partitioning and chunking, _summarizing_ generates text-based summaries of images and tables. -This summarization is done by using the [GPT-4o](https://openai.com/index/hello-gpt-4o/) or -[Claude 3.5 Sonnet](https://www.anthropic.com/news/claude-3-5-sonnet) models. +This summarization is done by using models offered through these providers: + +- [GPT-4o](https://openai.com/index/hello-gpt-4o/), provided through OpenAI. +- [Claude 3.5 Sonnet](https://www.anthropic.com/news/claude-3-5-sonnet), provided through Anthropic. +- [Claude 3.5 Sonnet](https://aws.amazon.com/bedrock/claude/), provided through Amazon Bedrock. Here is an example of the output of image summarization using GPT-4o. Note specifically the `text` field that is added. Line breaks have been inserted here for readability. The output will not contain these line breaks. @@ -68,19 +71,20 @@ Line breaks have been inserted here for readability. The output will not contain } ``` -## Summarize images and tables +## Summarize images or tables -To summarize images and tables, in the **Enrichment model** section of an **Enrichment** node in a workflow, specify the following: +To summarize images or tables, in the **Task** drop-down list of an **Enrichment** node in a workflow, specify the following: You can change a workflow's summarization settings only through [Custom](/platform/workflows#create-a-custom-workflow) workflow settings. -For image summarization, choose one of the following: +For image summarization, select **Image Description**, and then choose one of the following provider (and model) combinations to use: -- **OpenAI Image Description**: Use GPT-4o to summarize images. [Learn more](https://openai.com/index/hello-gpt-4o/). -- **Anthropic Image Description**: Use Claude 3.5 Sonnet to summarize images. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet). +- **OpenAI (GPT-4o)**. [Learn more](https://openai.com/index/hello-gpt-4o/). +- **Anthropic (Claude 3.5 Sonnet)**. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet). +- **Amazon Bedrock (Claude 3.5 Sonnet)**. [Learn more](https://aws.amazon.com/bedrock/claude/). -For table summarization, choose one of the following: +For table summarization, select **Table Description**, and then choose one of the following provider (and model) combinations to use: -- **OpenAI GPT-4o Table Description**: Use GPT-4o to summarize tables. [Learn more](https://openai.com/index/hello-gpt-4o/). -- **OpenAI GPT-4o Table to HTML**: Use GPT-4o to convert tables to HTML format. [Learn more](https://openai.com/index/hello-gpt-4o/). -- **Anthropic Table Description**: Use Claude 3.5 Sonnet to summarize tables. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet). \ No newline at end of file +- **OpenAI (GPT-4o)**. [Learn more](https://openai.com/index/hello-gpt-4o/). +- **Anthropic (Claude 3.5 Sonnet)**. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet). +- **Amazon Bedrock (Claude 3.5 Sonnet)**. [Learn more](https://aws.amazon.com/bedrock/claude/). \ No newline at end of file diff --git a/platform/workflows.mdx b/platform/workflows.mdx index e83c6e47..4621f273 100644 --- a/platform/workflows.mdx +++ b/platform/workflows.mdx @@ -321,15 +321,28 @@ To create an automatic workflow: - For **Enrichment model**, choose one of the following: + For **Task**, choose one of the following: + + - **Image Description** to summarize images. Also select one of the following provider (and model) combinations to use: + + - **OpenAI (GPT-4o)**. [Learn more](https://openai.com/index/hello-gpt-4o/). + - **Anthropic (Claude 3.5 Sonnet)**. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet). + - **Amazon Bedrock (Claude 3.5 Sonnet)**. [Learn more](https://aws.amazon.com/bedrock/claude/). + + [Learn more](/platform/summarizing). - - **OpenAI Image Description** to use GPT-4o to summarize images. [Learn more](https://openai.com/index/hello-gpt-4o/). - - **OpenAI Table Description** to use se GPT-4o to summarize tables. [Learn more](https://openai.com/index/hello-gpt-4o/). - - **OpenAI Table to HTML** to use GPT-4o to convert tables to HTML. [Learn more](https://openai.com/index/hello-gpt-4o/). - - **Anthropic Image Description** to use Claude 3.5 Sonnet to summarize images. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet). - - **Anthropic Table Description** to use Claude 3.5 Sonnet to summarize tables. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet). + - **Table Description** to summarize tables. Also select one of the following provider (and model) combinations to use: + + - **OpenAI (GPT-4o)**. [Learn more](https://openai.com/index/hello-gpt-4o/). + - **Anthropic (Claude 3.5 Sonnet)**. [Learn more](https://www.anthropic.com/news/claude-3-5-sonnet). + - **Amazon Bedrock (Claude 3.5 Sonnet)**. [Learn more](https://aws.amazon.com/bedrock/claude/). - [Learn more](/platform/summarizing). + [Learn more](/platform/summarizing). + + - **Table to HTML** to convert tables to HTML. Also select one of the following provider (and model) combinations to use: + + - **OpenAI (GPT-4o)**. [Learn more](https://openai.com/index/hello-gpt-4o/). + For **Select Embedding Model**, select one of the following: