Skip to content
Branch: master
Find file History
Scott Cate Scott Cate
Scott Cate and Scott Cate Updating
Latest commit af5bc26 Dec 6, 2019
Type Name Latest commit message Commit time
Failed to load latest commit information.
images ported instructions (#21) Oct 31, 2019
src Typo fix on Postman template (#40) Dec 3, 2019 ported instructions (#21) Oct 31, 2019 ported instructions (#21) Oct 31, 2019 update two training data links AIML10 Nov 28, 2019 Fixed video link for Demo 3 (#39) Dec 2, 2019 ported instructions (#21) Oct 31, 2019 add name of demo to title Nov 28, 2019 ported instructions (#21) Oct 31, 2019 Updating Dec 6, 2019 ported instructions (#21) Oct 31, 2019

AIML10: Making Sense of your Unstructured Data with AI

Session Abstract

Tailwind Traders has a lot of legacy data that they’d like their developers to leverage in their apps – from various sources, both structured and unstructured, and including images, forms, pdf files, and several others. In this session, you'll learn how the team used Cognitive Search to make sense of this data in a short amount of time and with amazing success. We'll discuss tons of AI concepts, like the ingest-enrich-explore pattern, skillsets, cognitive skills, natural language processing, computer vision, and beyond.

Table of Content

Resources Links
PowerPoint - Presentation
Videos - Dry Run Rehearsal
- Microsoft Ignite Orlando Recording
Demos - Demo 1 - Azure Cognitive Search
- Demo 2 - Forms Recognizer Service
- Demo 3 - Creating a Custom Invoice Reader Skill
- Demo 4 - Tying it all Together
- Demo 5 - Knowledge Store


In this solution we develop a process whereby we take a set of unstructured pdf invoices and generate structured tabular output using Azure Cognitive Search with a customized Form Recognizer Skill.

When creating this solution there are a few Azure resources (free trial here if you need it) that are created. The following tables list each resource, its purpose, and any special instructions needed to implement the solution fully (I use the names as presented during the talk but they will need to be renamed for your particular solution):

Azure Resources

Azure Resources

Name Type Purpose
ttcognitivesearch Resource Group Groups services together
ttinvoicestorage Storage Account Used to store invoices
ttinvoicesearch Search Service Featured service
ttinvoiceintelligence Cognitive Services (All-In-One) Used in the search service
ttinvoicereader Form Recognizer Service This service will eventually end up in the All-In-One sevice. For right now it is in limited-access preview. To get access to the preview, fill out and submit the Form Recognizer access request form.
readerskillstorage Storage Account Storage used for Azure Function
readerskill Function App Cognitive Skill App
readerskill App Insights Adds insights to Function App
EastUS2LinuxDynamicPlan App Service Plan Consumption based plan for running Function App



This talk consisted of the 5 demonstrations listed below.

Teardown Instructions

Full Teardown

  • Enter the Azure Portal and delete the Azure Resource Group you created to remove all resources for this project

Resources and Continued Learning

Microsoft Learn:

Azure Documentation

Feedback Loop

Do you have a comment, feedback, suggestion? Currently, the best feedback loop for content changes/suggestions/feedback is to create a new issue on this GitHub repository. To get all the details about how to create an issue please refer to the Contributing docs

Become a Trained Presenter

To become a trained presenter, contact In your email please include:

  • Complete name
  • The code of this presentation: aiml10
  • Link to a video of you presenting (~10 minutes in length)(ex: unlisted YouTube video).

    It doesn't need to be this content, the importance is to show your presenter skills

A mentor will get back to you with information on the process.

Trained Presenters

Thanks goes to these wonderful people (emoji key):

Seth Juarez
Seth Juarez

📢 📖
You can’t perform that action at this time.