Enabling support for XR in CSS3DRenderer

[andreacarpibomber]

It would be highly beneficial to render CSS objects in 3D in VR mode, like iframes! This would de a huge milestone, and I think that is possible since WebGLRenderer already supports WebXR.

[Mugen87]

To clarify things, you can't use DOM elements in XR except when the WebXR DOM Overlays Module is enabled. However, this extension is intended for 2D interactive content presented as an overlay.

Instead, you have to render DOM elements into a canvas and then use them as textures in your 3D scene. HTMLMesh does this which is used e.g. in webxr_vr_sandbox.

I think integrating HTMLMesh into the CSS renderers somehow is out-of-scope right now.

[andreacarpibomber]

Looks promising! But does it provide interaction with the HTML allowing users to scroll and touch buttons? I think this would be very useful indeed!

[Mugen87]

HTMLMesh dispatches events to the original DOM element and then redraws the canvas to honor UI changes. So interaction is possible.

[andreacarpibomber]

I will try! Thanks!