MeshExpert Live! requires hardware drivers and MeshExpert software to be installed. This guide will show you step-by-step how to to this.
Please make sure you have Windows 10 pro and above as operating system. The Windows 10 Home Edition is not suitable for developing purpose.
For Windows 10 versions, we recommend the Creators Update (ver.1709) or above if you are planning to install Windows 10 or can upgrade it. The new creators update includes some essential updates required by Unity 2017.
Make sure you have properly set up your basic desktop environment like installing mainboard drivers.
For this guide, we use the BlackMagic Capture Card and NVIDIA GeForce GTX 10 series video card. For other cards, please install proper drivers yourself.
Go to BlackMagic Download Page to checkout the latest driver version for the capture card. The latest version is always preferred. If you have any trouble getting the video feed, one of the most important trouble shooting step is to update the driver to the newest.
For now (12/19/2017), the newest version is 10.9.7 for Windows. Here is the direct download link.
Go to NVIDIA Driver Search Page to find the latest driver for your video card. The latest version is always preferred.
For now (12/19/2017), the newest version for GeForce GTX cards is 388.59 for Windows 10 64-bit. Here is the direct download link.
To make sure the capture card and its drivers are properly installed, after restart you can use the Blackmagic Media Express software from the Windows Start Menu to test. If ok, there would be a live stream displayed under the "Log and Capture" tab.
BlackMagic Media Express
This step is optional if just want to try SolarSystemExplorer instead of compiling it or creating your own app. You can skip this step and download and install the compiled apps. However, we do recommend you to install the Windows 10 SDK (which can be selected to install during Visual Studio installation) to enable debugging by connecting to your HoloLens. If you only want to install Windows 10 SDK without installing Visual Studio, download and install from here.
The METoolkit and SolarSystemExplorer app now support Unity 2017. We recommend Unity 2017 for users when starting a new project and upgrade to the new Unity versions if possible for previous projects.
Please note that support for legacy Unity version 5.5 is now moved to a new branch "Branch_2.2_ForUnity5.5.1". The master branch is only compatible with Unity 2017.
Download and run the Unity Download Assistant at Unity website. For UWP support, make sure you check the "Windows Store .NET Scripting Backend" entry during the installation (default is checked).
Unity Installation
Note: You can search and download Unity Versions here. For detailed installation and usage of Unity, check out the Unity Documentation.
What you need is Visual Studio 2015 Community V3 or later. Currently we recommend vs2015. For online installation of vs2015 V3, use this installer.
Note 1: For complete ISO installation file or other Visual Studio versions, go to Visual Studio Site. You can download community version with a free subscription.
Note 2: Make sure you check the Windows 10 SDK during the installation, otherwise you can not connect to HoloLens to debug your applications.
To understand how the MeshExpert Live! works and what software to install, see the drawing below. There are essential three major software to install or run:
- MeshExpert Installer: It includes the MeshExpert Server and MeshExpert Center. The Center is for: 1) manage service status (e.g. start/restart server) and license, 2) add and manage HoloLens, 3) upload and install apps to HoloLens and app configuration management , 4) other extended functionalities like connecting to DataMesh cloud service. The Server is responsible to cross-device collaboration by broadcasting messages among PC, HoloLens, Surface, etc.
- DataMesh LiveAgent: It is running on HoloLens on the Rig. It is constantly sending anchor information to the App you are running (e.g. the SolarSystemExplorer PC app) for the holographic video synthesis.
- Your App: Take SolarSystemExplorer as an example. You can build your app in Unity and compile it against different platforms. Then you will get the PC version, HoloLens version, and the Surface version. Through collaboration mechanism provided by MeshExpert Server, they can share the same MR experience. For example, during MR video capturing, you can control the movements from a Surface or another HoloLens.
Software Stack
To install the MeshExpert Server and MeshExpert Center, download the MeshExpert Installer and double click to install. Note that you need Administrative privilege.
Upon finish, you will have MeshExpert Center icon on your desktop and start menu under DataMesh entry.
MeshExpert Center
You need an online subscription or an offline license to get started. You can apply a trial license at https://license.datamesh.com. Online subscription is preferred. If you do need offline license or customized licensing options, you can send an email to service@datamesh.com. See more at the Account and Purchase.
Also see MeshExpert Center User Guide to know more about MeshExpert Center.
Download the latest version from here. To install it to the HoloLens on the Rig, you can either use the MeshExpert Center to do easy installation and configuration, or use the Windows Device Portal to do it manually. Here we only install the LiveAgent app, and the configurations will be elaborated later in the Configuration Guide.
Go to My Apps tab. Choose App Package and its Dependency. Then click UPLOAD. See below.
Upload App
You will see the unloaded packages at the bottom of My Apps tab.
To use MeshExpert Center to install the LiveAgent to a HoloLens, you need to first add you HoloLens to MeshExpert Center. See how?.
Important Note:
MeshExpert uses the Windows Device Portal APIs to connect to HoloLens. Two pre-conditions should be met before you can connect to HoloLens:
- The Windows 10 SDK we mentioned early is installed to your PC.
- The Developer Mode is turned on for your HoloLens.
See this doc for how to set up HoloLens to use device portal. (You will also learn how to use web browser or USB cable to connect to HoloLens, which can be used to test if your HoloLens can be connected. The device portal is very useful for developers.) Then you can try to add your HoloLens to MeshExpert Center.
Add HoloLens
Install App
- Go to the Devices tab.
- Under the Device Management, choose the HoloLens you are about to install LiveAgent to.
- Select the DataMeshLiveAgent under Application Manager.
- Click INSTALL.
You can use START, REMOVE, CONFIG to manage status of the LiveAgent here. If you click START, you will see it appearing under the Running Application. See below.
App Status
For demo, you can just download the compiled apps and move on to the next section to configure and run.
If you are a developer and dive deeper, you can get the source code from this Github Repository and follow the step-by-step tutorials to build your first app with MeshExpert and then move on to the full SolarSystemExplorer app.
You can download and run PC version directly. No installation needed.
You can install the SolarSystemExplorer app to HoloLens just like LiveAgent App. You upload the app, choose your HoloLens, and select the app and install. This is actually optional for recording third-person view of the Holograms. However, you can use another HoloLens (besides the HoloLens on the Rig) to interact and collaborate with other devices.
This is optional if you do not need to use Surface to control the interactions.
Install Surface Version
Click to run the Add-AppDevPackage.ps1 script. You will be prompted to confirm and continue.
Surface App Installation Process