Skip to content

Interesting HoloLens projects

Erik Vullings edited this page Aug 18, 2017 · 13 revisions

HoloLens open source projects and demos

Shows a collection of open source projects and demos that I've come across.

Microsoft's contributions

HoloLens CompanionKit

Link

This is a toolkit style repo for code bits and components that do not run on HoloLens but pair with HoloLens to build experiences. HoloLensCompanionKit contains the following feature areas:

This code sample shows how to create a desktop or UWP app that provides holographic content via remoting. Holographic remoting allows your app to host holographic content on a desktop PC, or on a UWP device such as the XBox One, allowing access to more system resources and making it possible to integrate holographic views into existing desktop PC software. This code sample includes desktop, UWP, and UWP XAML projects that all provide remoting content.

To enable it while working with Unity, see here or follow this guide.

HoloLens Commander is a Universal Windows application that demonstrates using the Windows Device Portal in a classroom environment. It enables observation and management of one or more HoloLens devices. This application is built upon the open source Windows Device Portal Wrapper project and is used by the Microsoft HoloLens team in the Holographic Academy.

Using the Kinect to set your intrapupil distance.

Mixed Remote View Compositor(MRVC) provides the ability for developers to incorporate near real-time viewing of HoloLens experiences from within a viewing application. This is achieved through low level Media Foundation components that use a lightweight network layer to transmit the data from the device to a remote pc viewing application. Through the Media Foundation capture pipeline, the sink components capture and encode the live camera data with its associated data. The data is then transmitted to the remote viewing application that will be decoded and displayed with respect to the device transformations. There are two methods of operation:

  1. Low latency mixed reality capture (MRC)
    • Provides the ability to create a MRC companion app experience with lower latency (~150ms)
    • Similar to Device Portal and Companion app experiences for mixed reality capture
  2. Mixed Remote View Compositing
    • Provides the ability to composite the mixed reality capture on a remote machine, allowing the HoloLens user experience to remain at full frame rate
    • Capture HoloLens camera images (PV camera) with its transformation data and transmits data to a remote application.
    • Using an additional network connection, synchronize scene and input state data to reflect any changes to the world objects.
    • Composite a rendered frame of the scene object with PV camera image to re-create a mixed reality image.

Skype + Hololens for remote support.

Smart home

  • Turn on/off your lights, tv, sonos, see the sensor status and much more in my TNO colleague Arnoud de Jong's home here.

Bentley has also developed a couple of nice applications

GIS based application (for urban planning, oil & gas):

Medical examples

Trading floor

TouchLine GooRoo Assembly support

Link Fix the power cable of a device.

CSI like Room Modeller

Link Kind of CSI demo, where many pictures are taken from the room, and added to the 3D depth model of the room. Youtube

Pokemon Demo

Github, Movie

Fire door and extinguisher inspector

Youtube

Buy your kitchen using Hololens (from Lowes)

Youtube

FitBox IPD

Link - page includes a link to a binary The FitBox and IPD tool was developed for those who frequently give demonstrations of HoloLens at meetup groups or other events. It serves two purposes:

  1. Replicates the opening screen of the Calibration app, which helps users make sure they've positioned the device correctly.
  2. Allows the IPD to be set quickly using a voice command instead of needing a companion PC and the Device Portal. The FitBox IPD tool should only be used in demonstration scenarios that require the device to be reconfigured quickly. In these scenarios, a high quality opticians pupilometer (like this) should be used to measure the IPD. Outside of this unique scenario, users should continue to leverage the built-in Calibration app to adjust the device for their eyes.

Subtitles

Link Uses Text2Speech to show subtitles in the Hololens (aid for hearing impaired people)

Facial recognition for the Microsoft Hololens.

Link Air tap or click with the clicker to take a photo/post it to the Face API

HoloLens + BIM:

Link Building information modeling (BIM) design and construction validation tool in Hololens. The idea is to overlay a BIM model over Real World in Hololens and have IoT and BIM content integration. https://www.youtube.com/watch?v=1SLxA_5NHI8

Alternatives

ODG 4K AR preview (no gesture control – small mousepad on the glasses)

Youtube Youtube

Meta2

Youtube