XR Animator v0.4.2 - Windows app version

Changes

• Add support for using mouse to control the UI apart from keys
• Add a new pose for mocap overlay
• Fix a bug in face-only mocap which caused error when used on certain poses
• Fix a bug in speech bubble in which the content layout might change unexpectedly ignoring the configured parameters
• Fix error message when switching between full-body and upper-body mocap of "Stand simple" pose
• Fix a bug in handling leg-FK motions in which the leg animation might break if used in mocap
• Update the naming of some motion config properties
• Update the config of some preset poses

XR Animator v0.4.0 - Windows app version

Changes

• Add "arm-to-leg" control mode, which translates arm mocap data to leg, allowing you to control the legs of your 3D model with your arms (video demo)
• Add numerous global hotkeys for various purposes, such as switching motions (video demo)
• Add 3D camera lock to save a camera position with Ctrl+L, so that it can be restored upon camera reset (video demo)
• Add multiple new preset poses for use with upper body mocap
• Add support for auto following of 3D camera with poses during mocap (video demo)
• Add support for importing/exporting of motion config as JSON (video demo)
• Improve accuracy in translating moocap data to 3D motion
• Improve accuracy in arm/leg IK calculations
• Improve efficiency in calculating IK/transform bone hierarchy
• Improve smoothness in motion recording, especially in real time when the recording frame rate can be low
• Improve accuracy and efficiency in motion recording
• Improve FBX motion loader compatibility
• Fix a bug in scene loader in which an imported object's rotation was reset when manipulated or exported
• Fix a bug in scene loader which failed to load wallpaper with white spaces in filename
• Fix a bug in sub animations and poses in which the arm rotations were displaced when mocap was active but not in use yet
• Fix "Stand simple" pose in which the camera position could be wrong when upper-only mocap was used
• Update three.js and three-vrm
• Local video as mocap input is now muted by default

XR Animator v0.3.0 - Windows app version

Changes

• Add "Media recorder" for quick video capture without relying on external app like OBS (video demo)
• Add support for MMD camera motion
• Add support for video background, along with MMD motion, camera and audio file zipped as a single input package (video demo)
• Add support for custom gravity in VRM model ("Air blower" now works with VRM model)
• Update menu icons and info to better reflect their functionality
• Update snapshot function to be trigger by key F12 instead of mouse click, along with the new video capture function also triggered by keys (F9 to start, F10 to end)
• Update intro message to be automatically hidden upon user inputs
• Improve media control for external motion
• Improve FBX motion loading on app start

XR Animator v0.2.5 - Windows app version

Changes

• Improve FBX motion support (video demo)
• Improve animation retargeting for loaded motions
• Add the feature to automatically save the path of the last used 3D avatar model and enable it on start
• Fix glitching when face-locking camera is reset
• Update codes for raycasting from mouse
• Update Electron (v22.2.0)
• Update three.js and components
• Update jszip.js
• Use import map for dynamic modules

XR Animator v0.2.0 - Windows app version

Changes

• You can now build your own 3D scene with 3D objects (.x/.glb), image and video, with full control over position/rotation/scale/etc using keyboard controls (video demo)
• You can explore your own 3D scene with your avatar using standard WASD/Space controls, with 3D collisions (video demo)
• You can export/import 3D scene built with XR Animator in JSON format (for online browser version of XR Animator, you need to include all 3D objects and the scene JSON file inside a zip). A sample scene XR-Animator_scene_sample_wizard.zip is available for download as a demonstration (video demo)
• Background transparency for Windows app version (Electron) is now configurable, and is ON by default (the reason for this change is because the latest OBS now supports direct transparency capture on Electron window without using chroma key)
• Improve VRM physics
• Add support for video wallpaper
• Add "Camera face-locking" option, which allows the 3D camera to lock the face of your avatar (it's "Auto" by default, which applies only when a 3D scene is used)
• UI items have been updated and re-arranged to better suit XR Animator as a mocap app
• Fix some camera control issues in browser mode after the window has been resized
• Fix the bug which prevents external 3D objects from being removed
• Fix the wallpaper changer in browser mode
• Restore the emulation of MMD wrist twist (手捩) rotation in VRM model when using mocap

XR Animator v0.0.5 - Windows app version

Changes

• Improve eye rotation for VRM models
• Add "one Euro filter" to smooth some joint rotations (and potentially facial expressions in the future)
• Disable speech bubble transparency when green screen is used
• Fix the bug of "VSeeFace mode" on tray menu not showing the correct status sometimes
• Add electron-as-wallpaper module to restore the "Stay on desktop" feature (previously implemented in AutoIt)

XR Animator v0.0.4 - Windows app version

Changes

• All AutoIt-related executables, which are mostly irrevelant to XR Animator, have been removed to avoid confusion

XR Animator v0.0.3 - Windows app version

Changes

• Fix a regression bug in translating pose detection data to joint rotations when the person being tracked is turning backward

Personal note: I really miss the time maintaining just the online version when I don't have to upload a 300MB file just for some simple changes in one file lol

XR Animator v0.0.2 - Windows app version

Changes

• Fix a bug which breaks the app when VMC-protocol is used and the VRM model doesn't have all the bones required
• Fix the bone positions sent by VMC-protocol with correct scaling
• Fix the "Hide 3D avatar" option to actually work with VMC-protocol
• Add "VSeeFace mode" in tray menu for VMC-protocol (enable it to override the default VSeeFace camera)
• Fix some update issues with tray menu
• Reduce the scale of eye rotation for VRM models to make eye tracking look more natural
• Fix a bug in thumb rotation for VRM models

XR Animator v0.0.1 - Windows app version

This is the initial release of the Windows app version of XR Animator, our new featured web app based on System Animator Online, which supports full-body motion tracking using just a single webcam, right on your web browser. It uses the machine learning (ML) solution from MediaPipe and TensorFlow.js to detect the 3D poses from a live webcam video, which is then used to drive the 3D avatar (MMD/VRM model) as if you are controlling it with your body. It can be used for whatever XR purpose, and even for VTubing.

This Windows app version (powered by Electron) provides a few extra features (e.g. VMC-protocol, transparent background) available only in a native-OS environment.

Features

• Support full-body AI motion tracking using a single webcam or media file (image/video)

• Support using any MMD/VRM model as your 3D avatar

• Record mocap motion and export it to VMD motion format

• Support loading VMD/BVH/FBX(Mixamo) format 3D motions

• Export BVH/FBX motions to VMD format

• Customize the background with still image, 3D panorama, 3D object (.x format), or a plain simple green screen for VTubing and video recording with a transparent background

• Support VMC-protocol to animate a 3D model elsewhere in other VMC-enabled applications such as VSeeFace, Unity and Unreal Engine (Windows version only)

• Support frameless window with transparent background (via green screen) on video capture apps such as OBS (Windows version only)

Check out these YouTube video demos and watch XR Animator in action!