This application demonstrates the exceptional capabilities of Azure AI Cognitive Services in extracting data from various unstructured file formats. Additionally, it provides insights on how OpenAI can be seamlessly integrated into workflows to develop valuable applications. By utilizing interactive demos and features, users can explore the impressive capabilities of OpenAI's machine learning and natural language processing. The OpenAI large language model (LLM) enables quick comprehension and analysis of unstructured data such as audio files, PDFs, and videos. Leveraging Azure Cognitive Services and the Power Platform, organizations can automate processes for improved handling of inquiries, feedback, and conversations, thus empowering their operations.
This application is built on PowerPlatform and used Azure AI & Open AI http endpoints via PowerAutomate to connect to Azure Services.
App Landing Page: 
PDF Extraction and Ask Questions from extracted text:
Video Insights Extraction and Ask Questions from extracted text:
Let's build a Power App to use Azure AI & Open AI to Improve Productivity
What's needed
Azure Open AI
- Register for Azure Open AI - https://learn.microsoft.com/en-us/azure/cognitive-services/openai/overview
- Once got approved create Azure Open AI resource in Azure portal.
- Select region as East US
- At the time of writing this article davinci-003 is only available in East US
- Create a deployment inside the resource.
Computer Vision (for PDF extraction) https://portal.azure.com/#create/Microsoft.CognitiveServicesComputerVision
Speech Service (For Speech Extraction) https://portal.azure.com/#create/Microsoft.CognitiveServicesSpeechServices
Video Indexer (Extract insights from Video) https://learn.microsoft.com/en-us/azure/azure-video-indexer/video-indexer-get-started
Import PowerApp
- Download .zip file from repository
- Import package in PowerApps https://learn.microsoft.com/en-us/power-apps/maker/canvas-apps/export-import-app#importing-a-canvas-app-package
Update all the endPoints in PowerAutomate
- Video Indexer - OpenAIVideoToText
Update accesstoken in powerautomate
2. Computer Vision - OpenAIPDFExtraction
Update http url and key in powerautomate
- Speech - OpenAIAudioToText
Update http url and key in powerautomate
- OpenAI - Openaigeneral, Openaisummarization-Summary
