System for Telementoring with Augmented Reality. Mentee subsystem.
- Homepage: https://engineering.purdue.edu/starproj/
- Mentor subsystem: https://github.com/edkazar/MentorSystemUWPWebRTC
A PC and a HoloLens. Follow the instruction in https://docs.microsoft.com/en-us/windows/mixed-reality/using-the-windows-device-portal to set up Windows Device Portal for the HoloLens.
- Get the app
- On the PC, download the latest release at https://github.com/practisebody/STAR/releases
- Unzip STAR_x.x.x.x_Test.zip and locate STAR_x.x.x.x_x86.appxbundle
- Connect to HoloLens
- Using Windows Device Portal to connect the PC to the HoloLens, either over Wi-Fi or over USB
- Upload to HoloLens. Note: This part might be not accurate if Windows Device Portal updates.
- Using Windows Device Portal, click on "Views > Apps > Deploy apps"
- Click on "Choose File", select the .appxbundle file in step 1. Note: Leave "I want to specify optional packages" and "I want to specify framework packages" unchecked
- Install
It is not recommended to compile from scratch. Follow the steps below when necessary.
- Unity (2017.4.3f1 or later)
- Visual Studio (2017, 15.9.9 or later), with the following components
- Universal Windows Platform development
- Game development with Unity
Also check https://docs.microsoft.com/en-us/windows/mixed-reality/install-the-tools of detailed instructions.
The following libraries are already included, listed here for the sake of completeness
- MixedRealityToolkit (used to called HoloToolkit)
- HoloPoseWebRtc
- Homepage: https://github.com/DanAndersen/HoloPoseWebRtc
- Using commit 30651138c9: https://github.com/DanAndersen/HoloPoseWebRtc/tree/30651138c916d1842e9608f4dfa5b38aad36b2cb
- Download or "git clone" this repository
- Build Visual Studio project by Unity
- Use Unity to open the project. Note: The first time to open the project may take a while load all the files
- Open "Scenes/Main" from project window
- Click on "File > Build Settings", choose "Universal Windows Platform" and click "Switch Platform"
- Check "Debugging > Unity C# Projects" and close the window
- If using later unity version, check "Edit > Project Settings > Player > Other Settings > Allow unsafe code". Note: this option is not available in 2017.4.3f1
- Click on "Mixed Reality Toolkit > Build Window", click "Build Unity Project"
- Run app by Visual Studio
- Open "UWP/STAR.sln" using Visual Studio
- Connect HoloLens to the PC over Wi-Fi or over USB
- In Configuration Manager, switch to "Release" and "x86". Select "Remote Machine" and put IP address of HoloLens if connected over Wi-Fi, select "Device" if connected over USB
- In Solution Explorer, right click on "Assembly-CSharp", open "Properties", check "Build > Allow unsafe code". Note: this step is not necessary if step 2e was performed
- Click "Debug > Start Debugging"