- GitHub Desktop Version 3.2.0
- Unity Hub 3.4.1
- Unity - Editor Version 2021.3.16f1
- Microsoft Visual Studio 2022
- HoloLens 2 Device
- Mixed Reality Tookkit Version 2.8.3.0
- Cognitive VR Version 1.0.3
Please clone the repository using GitHub Desktop. When you do this it will prompt you to download and install git lfs.
- Open the project from Unity Hub
- Press the Play Button.
-
Open the solution with Microsoft Visual Studio 2022
-
Set the Machine Name for Debugging.
-
Run.
- Open the Dashboard, Login needed.
- Click on the
National Institute of Standards and TechnologyOrganization. - Click on the
AR Usability EnvironmentProject. - One the left side of the window, under
Project, clickScenes - Click the scene
BaselineEnvironment. - Under the sessions, you will see all of the recorded Sessions.
- Cool little thing to note, that if you currently have a session running, you can click
View in SceneExplorerto see the lastest recording, even if it isn't showing up on the list yet.
- Cool little thing to note, that if you currently have a session running, you can click
You can test holographic object behavior with the Unity in-editor input simulation features.
To run the simulation, Press the play button.
-
Change the view in the scene:
- To move the camera forward/left/back/right, press the W/A/S/D keys.
- To move the camera vertically, press the Q and E keys.
- To rotate the camera, press the right mouse button and then drag.
-
Simulate hand input:
- To enable the simulated right hand, press and hold the space bar. To remove the hand, release the space bar.
- To enable the left simulated hand, press and hold the left shift key. To remove the hand, release the key.
- To move either hand around the scene, move the mouse.
- To move the hand forward or backward, rotate the mouse scroll wheel.
- To simulate the pinch gesture, click the left mouse button.
- To rotate the hand, press and hold down the space bar + CTRL key (right hand) or left shift key + CTRL key (left hand) and then move the mouse.
-
Persistent hands
- To enable a hand and keep it onscreen without continuing to hold down a key, press T (left hand) or Y (right hand).
- To remove the hands, press those keys again.
When running the application, the HoloLens 2 view is being recorded. The video can be found by opening the File Explorer in the Windows Device Portal. (System -> File explorer)
The Windows Device Portal is opened while navigating to the webaddress of the HoloLense 2, while it is activated.
For example, this was mine:
https://192.168.1.23/default.htm#File%20explorer
Note: If you do not know your login information for the Device Portal, you can reset the credentials by repeatedly clicking the log in button.
The video is located in:
U:\Users\james\AppData\Local\Packages\NIST_*\LocalState\ARBaselineEnv_*.mp4, where the asterisk represents a generated string, which changes every install.
Note: The video will not be playable until you exit the app



