V1.0-Release

V1.0 is the first public release of Babble Frame Runtime: eye and mouth expression tracking that runs on the Steam Frame itself and sends to VRCFaceTracking on your PC.

What it does

• Eye expressions: openness, widen and pupil dilation for each eye, from the Frame's eye cameras.
• Gaze: each eye's own gaze from the headset's eye service, or SteamVR's combined gaze.
• Mouth tracking: 43 blendshapes from a Babble USB face tracker plugged into the headset.
• Presence: tracking pauses and the cameras turn off while the headset is off your head.
• SteamVR Settings: an Expression Tracking section turns mouth and eye tracking on and off and sets the eye tracking rate. Turn on Show App Window there for the Babble tab in the SteamVR dashboard.
• Output: VRCFaceTracking on your PC, through the Project Babble module. The headset finds the module on your network by itself.

Install

On the Steam Frame, switch to Desktop Mode, open Konsole and paste:

curl -fsSL https://raw.githubusercontent.com/Project-Babble/Babble-Frame-Runtime/main/tools/get.sh | bash

It downloads this release, checks it against its SHA-256 checksum, installs it in your home folder and restarts SteamVR. It replaces any previous install; your settings and logs are kept. Then turn on Show App Window in SteamVR Settings, under Expression Tracking, for the Babble tab in the SteamVR dashboard. Later updates show up there, next to the version.

To install by hand instead, download the .tar.xz below and run, in the folder you saved it to:

tar -xf babble-frame-runtime.linuxarm64.V1.0-Release.tar.xz
./install.sh

To remove it, run ~/.local/share/babble-frame-runtime/uninstall.sh.

Reporting problems

Use the Diagnostics page in the Babble tab to save a diagnostics report and attach it to your report. It includes the version, your settings and the recent log.