Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added img/enriching/Image-Description-1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/enriching/Image-Description-2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/enriching/Image-Description-3.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/enriching/NER-Example.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/enriching/Table-Description-1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/enriching/Table-Description-2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
8 changes: 8 additions & 0 deletions ui/enriching/image-descriptions.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,14 @@ Line breaks have been inserted here for readability. The output will not contain
}
```

Here are three examples of the descriptions for detected images. These descriptions are generated with GPT-4o by OpenAI:

![Description of an image showing a scatter plot graph](/img/enriching/Image-Description-1.png)

![Description of an image showing the Matthews Correlation Coefficient for different VQA datasets](/img/enriching/Image-Description-2.png)

![Description of an image showing three scatter plots](/img/enriching/Image-Description-3.png)

Any embeddings that are produced after these summaries are generated will be based on the `text` field's contents.

## Generate image descriptions
Expand Down
5 changes: 5 additions & 0 deletions ui/enriching/ner.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -96,6 +96,11 @@ entities and their relationship types, using GPT-4o. Note specifically the `enti
}
```

Here is another example of some of the entities, their entity types, and relationships that are recognized for a given paragraph of text. This information
is generated by GPT-4o by OpenAI:

![Named entity recognition for information in a paragraph of text](/img/enriching/NER-Example.png)

By default, the following entity types are supported for NER:

- `PERSON`
Expand Down
6 changes: 6 additions & 0 deletions ui/enriching/table-descriptions.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,12 @@ Line breaks have been inserted here for readability. The output will not contain
}
```

Here are two examples of the descriptions for detected tables. These descriptions are generated with GPT-4o by OpenAI:

![Description of a table with information about endoscopic datasets](/img/enriching/Table-Description-1.png)

![Description of a table with information about potentiodynamic polarization of stainless steel](/img/enriching/Table-Description-2.png)

The generated table's summary will overwrite any previous contents in the `text` field. The table's original content is available
in the `image_base64` field.

Expand Down