This is a personal project that includes a face tracking relay from ALVR to OSC (VRCFT replacement), among other things.
Pros vs VRCFT:
- Runs on Linux
- Does not randomly crash
Cons vs VRCFT:
- Fine tuning of face tracking parameters can only be done in code
Supported:
- Quest Pro
- Pico 4 Pro (eye only)
- Project Babble
To build, using rustup is recommended!
If you have a Quest Pro:
- In ALVR, enable
VRCFaceTracking
andLog Tracking
.
If you use a Pico 4 Pro:
- In ALVR, enable
VRChat Eye OSC
andLog Tracking
.
There is a helper software to handle OscQuery for us at galister/VrcAdvert.
wget -O VrcAdvert https://github.com/galister/VrcAdvert/releases/latest/download/VrcAdvert
# change this link to babble if using babble
wget -O oscavmgr https://github.com/galister/oscavmgr/releases/latest/download/oscavmgr-alvr
chmod +x VrcAdvert oscavmgr
I recommend using this start script:
#!/usr/bin/env bash
trap 'jobs -p | xargs kill' EXIT
./VrcAdvert 9402 9002 &
./oscavmgr
This activates when your HMD is in hand-tracking mode. The bottom of the terminal will change from AP-OFF
to MANUAL
when active.
Turn left-right: Look at the left/right edge of your screen
Jump: Look at the top edge of your screen
Toggle Mute: Raise your eyebrows
Move forward: Puff up your cheeks
Move backwards: Suck with your cheeks
Auto loco switch:
- Switches walking animations off when in full-body mode.
Pose save:
- Saves the idle stand/crouch/prone pose between avatars.
Quick-ascend:
- While in Gogo flight mode, put both hands (controllers) above your head to ascend at a super-high speed.
This allows you to save infrequently used sync parameters in oscavmgr, so that they don't take up sync param space on your avatar.
Your corresponding animator state machine must be Write Defaults OFF for this to work.
Requires 4 parameters:
ExtIndex
key/name of the parameter to be savedExtValue
value of the parameter to be savedIntIndex
key/name of the variable coming from oscavmgrIntValue
value of the parameter coming from oscavmgr
To set a value:
- Set
ExtIndex
to an integer. This will be the key/name of your parameter. - Set
ExtValue
to a float. This is the value saved. This float can be 0/1 when saving a bool, or a number higher than 1 when saving an int.
To read a value:
- Have
ExtIndex
on 0 (otherwise oscavmgr will be stuck waiting for your input). - oscavmgr will iterate through all of your saved parameters and send them back to VRC (and other players) one at a time.
- In your avatar's FX animator, make a decision tree to handle the
IntValue
ifIntIndex
corresponds to a known value.
Enable this mod: galister/EyeTrackVRResonite (This is a fork that supports both Eye + Face)
With the mod enabled, simply start oscavmgr using cargo run --release
.
A set of DynamicValueVariables will be created for you. Use them to drive the blendshapes of your choice. (Network syncing is already handled for you).
If you are starting up Resonite after using VRC, you will need to restart oscavmgr!
Pico 4 Pro Users: Your eyes will be always closed. To fix this, flip the Open and Closed states for each eye in your avatar's EyeManager.