Unreal Engine Tutorial: VR Physics Based Hands and VR Tablet

In this example project you will find an implementation of a physics based VR hands using OpenXR, and the built in handtraking in the vrajo XR3. In addition a Blui (WebBrowser Widget) based VR tablet that you can interact with using your fingers.

Unreal Engine version 5.1

You will find the blue prints in those two actors, Tablet and VRPawn

---

VR Physics Based Hands

We will build on the two part "VR Procedural Virtual Hand Mesh Animation Using OpenXR Hand-Tracking" tutorial Part 1 Part 2 by Mamadou Babaei for the OpenXR hand tracking.

See PhysicsBasedHands.md

---

VR Tablet With Blui

See VRTabletWithBlui.md

---

Tie them together

to make the interaction between the finger tips and the tablet posible you need to add collision spheres on the finger tips and ensure that generate overlap is enabled.

make sure to make the parent socket of the spheres the related bone you want. Example: