Hand tracking support + elbows without controllers #149
Conversation
This extends the HMD skeleton to support arm tracking. We do end up with kinda duplicate bones tho. If user has controllers: elbows go from controllers with tracker on lower arm and possibility for upper arm tracker. If user has no controller (or no feeder app) and enables Elbow SteamVR trackers: elbows go from chest. If user has no controllers and enables Hand SteamVR trackers: SteamVR trackers on the users hand appear using upper arm, forearm and hand trackers. Use chest tracker as well for more precision. This also adds a lot of body proportions...
|
Video of hand tracking in action: https://cdn.discordapp.com/attachments/833895618450948106/960707193001349200/2022-04-04_20-54-18.mp4 |
Also makes my code a whole lot clearer damn. Now I can understand it myself!!! :P
|
If the elbow tracker uses hand tracker to build its own chain, it's bad. Elbow tracker should use either Conroller -> Elbow chain or if controller doesn't exist, Shoulder -> Elbow. |
|
sure, so just change make the computed tracker use either one depending on if there’s a controller or not right :3 |
|
yes, @Louka3000! that would make elbows more precise when using hand tracking, at least. |
Instead of moving the controller chains to the slimevr hand, now just make the computed elbows affected by the elbow from the slimevr hand chain. Also refactored some stuff to replace "upper arm distance" by "elbow offset". Idek if it's useful but it may be so I'm keeping it.
I don't think it actually makes it more precise because of the way I was doing it (all the offsets were the same back and forth basically), but it did make my code a whole lot better lol. |
This extends the HMD skeleton to support arm tracking. We do end up with kinda duplicate bones tho because of elbow tracking skeletons (from the controllers)
Basically: The HMD skeleton handles arm tracking and the Controller skeletons handle elbow tracking (even if the user is using arm tracking).
If the skeleton doesn't find a controller, it'll use the SlimeVR hand from the HMD skeleton.It uses the elbow from the shoulders to hand chain.This makes it so:
If user has controllers: elbows go from controllers with tracker on lower arm and possibility for upper arm tracker.
If user has no controller (or no feeder app) and enables Elbow SteamVR trackers: elbows go from chest/shoulders, using an upper arm tracker.
If user has no controllers and enables Hand SteamVR trackers: SteamVR trackers on the users hand appear using upper arm, forearm and hand trackers. Use chest tracker as well for more precision!
This also adds a lot of body proportions. Very fun.
Main use of this is for mocap and vtubing, not VR.