Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Joshuakr/7376 breyers image fix #638

Merged
merged 8 commits into from
Apr 12, 2024
2 changes: 1 addition & 1 deletion app/frontend/src/pages/tda/Tda.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -404,7 +404,7 @@ const handleCloseEvent = () => {
<Button variant="secondary" onClick={handleAnalysis}>Here is my analysis</Button>
<Button variant="secondary" onClick={handleAnswer}>Show me the answer</Button>
</div>
{loading && <div className="spinner">Loading...</div>}
{loading && <div className="spinner">Loading{dots}</div>}
{ (
<div style={{width: '100%'}}>
<h2>Tabular Data Assistant Response:</h2>
Expand Down
2 changes: 2 additions & 0 deletions docs/deployment/deployment.md
Original file line number Diff line number Diff line change
Expand Up @@ -153,6 +153,8 @@ If you have chosen to enable authentication and authorization for your deploymen

## Authorizing SharePoint

*If you do not see these connections, ensure you have the **ENABLE_SHAREPOINT_CONNECTOR** flag set to **true** during your deployment*

1. Go to your resource group in the [Azure Portal](https://portal.azure.com/), select the "sharepointonline" API Connection resource.
2. Click "Edit API Connection" in the menu on the left side of your screen.
3. Click "Authorize" and login with the user that has access to the SharePoint sites you put in your environment file. It is **strongly** recommended that you have created a new user for this purpose.
Expand Down
2 changes: 2 additions & 0 deletions docs/features/document_pre_processing.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,8 @@ For PDF's we use a service, known as [Azure AI Document Intelligence](https://le

Image processing for 'jpg', 'jpeg', 'png', 'gif', 'bmp', 'tif', and 'tiff' formats. Leveraging Azure's GPU optionally in regions where [available](https://learn.microsoft.com/en-us/azure/container-instances/container-instances-region-availability) to generate Captions and Deep Captions. We utilize the Cognitive Services [Computer Vision API](https://azure.microsoft.com/en-us/resources/cloud-computing-dictionary/what-is-computer-vision/?ef_id=_k_f4f6deceb1b41be24ecebbf7bfa0a48b_k_&OCID=AIDcmme9zx2qiz_SEM__k_f4f6deceb1b41be24ecebbf7bfa0a48b_k_&msclkid=f4f6deceb1b41be24ecebbf7bfa0a48b#object-classification) to generate descriptions and perform OCR on any text present within these image files. A JSON model of this data is then generated the same as with other document types.

Image Search is only available in regions that support dense captions. For a full list of these regions please see the official documentation for Azure Vision Image Captions [here](https://learn.microsoft.com/en-us/azure/ai-services/computer-vision/concept-describe-images-40?tabs=dense)

## Detailed Flow of Pre-Processing

In this section we explore the pre-processing flow in more detail, to enable you to understand the patterns employed and how you may adapt the configuration to meet your own needs. Below is a graphic representing the flow steps..
Expand Down
2 changes: 2 additions & 0 deletions docs/features/features.md
Original file line number Diff line number Diff line change
Expand Up @@ -80,6 +80,8 @@ With this addition, you can easily search for images in the Retrieval Augmented

When you upload images, data processing pipeline extractions captions and metadata of images and stores them in Azure AI Search Index. Now, when users ask questions using text, Retrieval pipeline extracts image captions matching user queries, allowing user to find images quickly. Just click on the citation, and the image will appear, making content retrieval a straight forward process. Additional information on this can be found [here](/docs/features/document_pre_processing.md)

Image Search is only available in regions that support dense captions. For a full list of these regions please see the official documentation for Azure Vision Image Captions [here](https://learn.microsoft.com/en-us/azure/ai-services/computer-vision/concept-describe-images-40?tabs=dense)

## Azure AI Search Integration

This accelerator employs Vector Hybrid Search which combines vector similarity with keyword matching to enhance search accuracy. This approach empowers you to find relevant information efficiently by combining the strengths of both semantic vectors and keywords.
Expand Down
3 changes: 3 additions & 0 deletions docs/features/sharepoint.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,9 @@ export SHAREPOINT_TO_SYNC='[
]'
```

#### ENABLE_SHAREPOINT_CONNECTOR
This needs to be set to **true** if you want to use the SharePoint feature, otherwise the required resources for the SharePoint feature will not be deployed

## Usage Instructions

1. Fill in the SHAREPOINT_TO_SYNC variable in the env file, example can be found above
Expand Down
4 changes: 4 additions & 0 deletions docs/knownissues.md
Original file line number Diff line number Diff line change
Expand Up @@ -196,3 +196,7 @@ export TF_VAR_appServiceSkuTier="Standard"
export TF_VAR_enrichmentAppServiceSkuSize="P1v3"
export TF_VAR_enrichmentAppServiceSkuTier="PremiumV3"
```
## My image search is not working and returning "I'm sorry, but I don't have any information about..."

### Solution
Image search is currently only supported with regions that support dense captions. You will need to deploy Information Assistant to one of the regions that supports dense captioning. A full list of regions that support dense captioning can be found [here](https://learn.microsoft.com/en-us/azure/ai-services/computer-vision/concept-describe-images-40?tabs=dense)