Skip to content

Patch #4519: Enabling to use far hands and eye input simultaneously - #4626

Merged
Will (wiwei) merged 21 commits into
microsoft:mrtk_developmentfrom
sostel:patch-4519
Jun 12, 2019
Merged

Patch #4519: Enabling to use far hands and eye input simultaneously#4626
Will (wiwei) merged 21 commits into
microsoft:mrtk_developmentfrom
sostel:patch-4519

Conversation

@sostel

@sostel sostel commented May 30, 2019

Copy link
Copy Markdown
Contributor

Overview

Allow users to use eye-based input while interacting with far hand rays. For example, a user is holding some holographic tools in her hands and wants to scroll through task descriptions using her eyes.

For more details on the issue, please see #4519.

Changes

  • Addressed Eye gaze and far interaction don't work together #4519.
  • To allow for using eye-based input while interacting with far hand rays, developers can use the EyeTrackingTarget script that already has several eye-gaze-related events ready for simply consumption, such as:
    • OnLookAtStart()
    • WhileLookingAtTarget()
    • OnLookAway()
    • OnDwell()
    • OnSelected()

EyeTrackingTarget.cs is polling and managing ET data independently from BaseEyeFocusHandler to allow for supplemental interactions (not relying on being the primary pointer). In addition, if required additional voice commands can be assigned. For example, the user is holding/manipulating a hologram with both her hands and then looks over to another hologram and says "put that one on this one" or "match the color of this one".

The documentation for this will be updated in combination with a bigger overhaul of the eye tracking documentation for #4596 .

sostel and others added 3 commits May 29, 2019 17:34
…hand rays are active and can be used in conjunction - e.g., while holding holographic tools in your hands, you can still auto scroll based on your eye gaze.
@sostel
sostel requested review from a user, Kurtis (keveleigh) and Will (wiwei) May 30, 2019 00:58
Comment thread Assets/MixedRealityToolkit.SDK/Features/Input/Handlers/EyeTrackingTarget.cs Outdated
Comment thread Assets/MixedRealityToolkit.SDK/Features/Input/Handlers/EyeTrackingTarget.cs Outdated
Comment thread Assets/MixedRealityToolkit.SDK/Features/Input/Handlers/EyeTrackingTarget.cs Outdated
Comment thread Assets/MixedRealityToolkit.SDK/Features/Input/Handlers/EyeTrackingTarget.cs Outdated

@ghost Deleted user (ghost) left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is great, thanks for fixing 👍

Updating sostel fork to latest from mrtk_development
@wiwei

Copy link
Copy Markdown
Contributor

/azp run mrtk_pr

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

Comment thread Assets/MixedRealityToolkit.SDK/Features/Input/Handlers/EyeTrackingTarget.cs Outdated
@wiwei

Copy link
Copy Markdown
Contributor

/azp run mrtk_pr

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

@wiwei
Will (wiwei) merged commit 1962151 into microsoft:mrtk_development Jun 12, 2019
@sostel
sostel deleted the patch-4519 branch July 25, 2019 21:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants