HoloDoc - Graduation Project

HoloDoc is a document classification application using augmented reality. This application is meant to be used with Microsoft HoloLens.

Setting up application for development

System requirements

To be able to develop on our application, there is a requirement configuration, defined in the part System requirements.

In summary:

• You need a 64-bit Windows 10 Pro, Enterprise or Education.
• 8GB of RAM or more
• In the BIOS, the following features must be supported and enabled:
  • Hardware-assisted virtualization
  • Second Level Address Translation (SLAT)
  • Hardware-based Data Execution Prevention (DEP)
• GPU (The emulator might work with an unsupported GPU, but will be significantly slower)
  • DirectX 11.0 or later
  • WDDM 1.2 driver or later

Moreover, you have to ensure that the "Hyper-V" feature has been enabled on your system. : Go Control Panel > Programs > Programs and Features > Turn Windows Features on or off > ensure that "Hyper-V" is selected for the Emulator installation to be successful.

Installation for HoloLens and immersive headsets

Now, you have to install different softwares described in the part Installation checklist for HoloLens and the part Installation checklist for immersive headsets.

In summary:

• Enable Developer mode : Go to Settings > Update & security > For developers
• Download and install Windows 10 Fall Creators Update
• Download and install Visual Studio 2017. During the installation, select the following workloads : "Universal Windows Platform development", "Game Development with Unity" and "Desktop development with C++"
• Download and install Windows 10 Fall Creators Update SDK
• Download and install HoloLens Emulator and Holographic Templates
• Download and install Unity 2017 and select "Windows Store .NET Scripting Backend" during the installation
• Update graphics drivers

Installation of Node.js and launching the server

Requirements

• Download and install Python 2.7.
• Download and install Git.
• Download and install CMake.
• Download and install Node.js.
• Download and install MongoDB.

After that, launch the program Node.js command prompt and go to the folder HoloDocServer with the command cd [APP_PATH]HoloDocServer. Then, type the command npm start to install and launch the server.

Project architecture

HoloDoc
  ├── HoloDocApp      // Code Unity
  ├── HoloDocDetector // Code C++ with OpenCV
  │     ├── DocDetectorDLL - UWP  // DLL UWP for Hololens/emulator (x86)
  │     └── DocDetectorDLL        // DLL for Unity (x86-x64)
  └── HoloDocServer   // Server Node.js