Skip to content

XR Animator v0.0.1 - Windows app version
Compare
Choose a tag to compare
@ButzYung ButzYung released this 20 Dec 08:06
· 427 commits to master since this release
XR-Animator_v0.0.1
a3ac03a

This is the initial release of the Windows app version of XR Animator, our new featured web app based on System Animator Online, which supports full-body motion tracking using just a single webcam, right on your web browser. It uses the machine learning (ML) solution from MediaPipe and TensorFlow.js to detect the 3D poses from a live webcam video, which is then used to drive the 3D avatar (MMD/VRM model) as if you are controlling it with your body. It can be used for whatever XR purpose, and even for VTubing.

This Windows app version (powered by Electron) provides a few extra features (e.g. VMC-protocol, transparent background) available only in a native-OS environment.

Features

  • Support full-body AI motion tracking using a single webcam or media file (image/video)

  • Support using any MMD/VRM model as your 3D avatar

  • Record mocap motion and export it to VMD motion format

  • Support loading VMD/BVH/FBX(Mixamo) format 3D motions

  • Export BVH/FBX motions to VMD format

  • Customize the background with still image, 3D panorama, 3D object (.x format), or a plain simple green screen for VTubing and video recording with a transparent background

  • Support VMC-protocol to animate a 3D model elsewhere in other VMC-enabled applications such as VSeeFace, Unity and Unreal Engine (Windows version only)

  • Support frameless window with transparent background (via green screen) on video capture apps such as OBS (Windows version only)

Check out these YouTube video demos and watch XR Animator in action!

Assets 3
Loading