Proposed updates (Sep 2023)

[luisquintanilla]

There are a few things that we need to update in the application to make deployment more reliable.

P0

• Remove unused strategies #135
• Remove AzureOpenAITextCompletionService #140
  • Remove gpt deployment AZURE_OPENAI_GPT_DEPLOYMENT / gptDeploymentName #161
• Update Semantic Kernel version to use ChatCompletionService #137
  • Update query prompt template to remove ChatML syntax #138
  • Update ReadRetrieveReadChatSErvice to use AzureOpenAIChatCompletionService #139
  • Update Answer Prompt Template #136
• Merge semantic search into main #120

P1

Infra

• Update main.bicep #128
• Add 'Deploy to Azure' button to deploy from the portal. #142

Ingestion

• Add Azure Function deployment #160
• Make PrepareDocs ingestion pipeline an Azure Function. #130
• Update UI to allow users to upload their own documents. #132
  • Add component to Chat page that allows users to upload their own documents
  • Use PrepareDocs Azure Function endpoint to upload and chat with documents.
• Remove PrepareDocs from build / deploy pipeline #131

Documentation

• Add guidance on how to debug the application (VS / VS Code Debugger) #134

P2

Infra

• Update main.parameters.json #127

Backend

• Remove unused Redis backend code #168

[bradygaster]

My 2C: Amplify PrepareDocs becoming an Azure Function to P0. Then remove that from the deployment-time stuff and add some sort of "upload your doc here" feature that would allow a user to upload a doc, then have the function that processes it and adds it's content to the back-end system a triggered event. So files are uploaded, then immediately added to the model so subsequent questions can be asked as new documents are uploaded.

[Coruscate5]

GetChatCompletions is what I came here for - still useful to have this sample but I haven't been able to figure streaming Chat responses through the Blazor API side, would be very useful to see this in the same project given how much difficulty I've had just getting it working

[LadyNaggaga]

Memory / Vector Store

• Merge semantic search into main #120

We may want to build a sample that uses some 3rd partner vector store

[LadyNaggaga]

We need to add authentication to this app if plan for people to upload docs. Just to follow best practices.

[luisquintanilla]

Closing since P0 items are complete. Pending issues tracked in #174