Skip to content

This is a plugin-like application that you can include in your project to record various metrics as a user interacts with your application. This data can then be used for usability analysis to determine where the user encountered hinderances to successfully performing a task.

License

Notifications You must be signed in to change notification settings

usnistgov/ARUsabilityMetricsEnvironment

Repository files navigation

ARUsabilityMetricsEnvironment

Setup Environment

Requirements

  • GitHub Desktop Version 3.2.0
  • Unity Hub 3.4.1
  • Unity - Editor Version 2021.3.16f1
  • Microsoft Visual Studio 2022
  • HoloLens 2 Device
  • Mixed Reality Tookkit Version 2.8.3.0
  • Cognitive VR Version 1.0.3

Steps

Please clone the repository using GitHub Desktop. When you do this it will prompt you to download and install git lfs.

Unity

  1. Open the project from Unity Hub
  2. Press the Play Button.

HoloLens 2

  1. Open the solution with Microsoft Visual Studio 2022

  2. Set the Solution Configuration to Release
    image

  3. Set the Solution Platform to ARM64
    image

  4. Set the Machine Name for Debugging.

    • From the Visual Studio menu; Project -> Properties
    • Under Configuration Properties, click Debugging
    • Under Debugger to launch, choose Remote Machine
    • In the section below, edit the Machine Name to the IP Address of the HoloLens 2 image
  5. Run.

    • From VS Menu, select "Debug" -> Start Without Debugging
      image

Cognitive3D

  • Open the Dashboard, Login needed.
  • Click on the National Institute of Standards and Technology Organization.
  • Click on the AR Usability Environment Project.
  • One the left side of the window, under Project, click Scenes
  • Click the scene BaselineEnvironment.
  • Under the sessions, you will see all of the recorded Sessions.
    • Cool little thing to note, that if you currently have a session running, you can click View in SceneExplorer to see the lastest recording, even if it isn't showing up on the list yet.

Unity

You can test holographic object behavior with the Unity in-editor input simulation features.

To run the simulation, Press the play button.

  • Change the view in the scene:

    • To move the camera forward/left/back/right, press the W/A/S/D keys.
    • To move the camera vertically, press the Q and E keys.
    • To rotate the camera, press the right mouse button and then drag.
  • Simulate hand input:

    • To enable the simulated right hand, press and hold the space bar. To remove the hand, release the space bar.
    • To enable the left simulated hand, press and hold the left shift key. To remove the hand, release the key.
    • To move either hand around the scene, move the mouse.
    • To move the hand forward or backward, rotate the mouse scroll wheel.
    • To simulate the pinch gesture, click the left mouse button.
    • To rotate the hand, press and hold down the space bar + CTRL key (right hand) or left shift key + CTRL key (left hand) and then move the mouse.
  • Persistent hands

    • To enable a hand and keep it onscreen without continuing to hold down a key, press T (left hand) or Y (right hand).
    • To remove the hands, press those keys again.

HoloLens 2

When running the application, the HoloLens 2 view is being recorded. The video can be found by opening the File Explorer in the Windows Device Portal. (System -> File explorer)

The Windows Device Portal is opened while navigating to the webaddress of the HoloLense 2, while it is activated.
For example, this was mine:
https://192.168.1.23/default.htm#File%20explorer

Note: If you do not know your login information for the Device Portal, you can reset the credentials by repeatedly clicking the log in button.

The video is located in:
U:\Users\james\AppData\Local\Packages\NIST_*\LocalState\ARBaselineEnv_*.mp4, where the asterisk represents a generated string, which changes every install.

Note: The video will not be playable until you exit the app

About

This is a plugin-like application that you can include in your project to record various metrics as a user interacts with your application. This data can then be used for usability analysis to determine where the user encountered hinderances to successfully performing a task.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published