HoloLens and A-Frame - Documentation and Features

[b-pos465]

I'm trying to make an existing A-Frame application usable with a Microsoft HoloLens. But I got problems finding out which features are supported and how they can be accessed. I am opening this issue so it can be used as a collection of useful links for all that are interested in this topic.

• One of the comments on Issue HoloLens Support #3513 states that "the click event is available on the Hololens via the GamePad API" (@rc1, @KJStrand).
• Furthermore, I found this explainer.md which describes some common low-level code.

What I am interested in:

1. Is it possible to use the speech input of the HoloLens like in Unity.
2. Is it possible to use spatial mapping?
3. Do you know about any abstractions / libraries for typical navigation problems like scaling, moving or rotating?
4. Do you know about any libraries for typical UI problems: world space vs. camera space?

Thank you for your contribution in advance!

[dmarcos]

For usage questions we recommend Stack Overflow. We use github issues for bugs and feature requests.

One of the comments on Issue #3513 states that "the click event is available on the Hololens via the GamePad API" (@rc1, @KJStrand).
Furthermore, I found this explainer.md which describes some common low-level code.

The explainer you pointed out is for the WebXR API that is not finished and has yet to ship. Not aplicable at the moment. Follow the Gamepad approach described in the issue.

Is it possible to use the speech input of the HoloLens like in Unity.

A-Frame and any other JS library are limited by the APIs available in browsers. There’s a Web speech API. Unfortunately, only available in Chrome at the moment. I don't know what Edge plans are concerning Hololens.

Is it possible to use spatial mapping?

For spatial mapping there will be eventually something exposed through WebXR. Conversations will likely happen in this repo: https://github.com/immersive-web/real-world-geometry

Do you know about any abstractions / libraries for typical navigation problems like scaling, moving or rotating?

That's a broad question. I recommend opening a question in StackOverflow with more details on what you're trying to accomplish and approaches you tried. There are existing components that might be useful like teleport or transform

Do you know about any libraries for typical UI problems: world space vs. camera space?

Broad question too. As a starting you have: https://github.com/etiennepinchon/aframe-material

[b-pos465]

@dmarcos Thank your for the detailed answer!

For now I decided to implement my application in Unity 3D. That way I can use all the available features.