Skip to content

Releases

v1.1.0

Choose a tag to compare

@jtydhr88 jtydhr88 released this 08 Nov 16:12

Live capture is steadier and easier to watch.

  • New smoothing input on InstantHMR Live Capture (default 0.5): the body holds still while you do and fast moves still come through. The 3D view, the character and VMC all use the smoothed pose. Higher is steadier; 0 shows the raw per-frame result.
  • The webcam (This device) preview is mirrored like a video call. Recordings and VMC keep the real left and right.
  • The 3D view follows the person, so they stay in frame when they move closer or further away.
  • Mouse controls in the 3D view: left drag to orbit, right drag to pan, click and scroll to zoom.
  • The status line updates twice a second with averaged numbers, and the axes are gone from the 3D view.
  • SAM3 tracks: a track is skipped in frames where its mask is empty, and dropped when its predicted body mostly falls outside its own mask (such as a raised arm detected on its own).
  • The README covers facial expressions with Face Expression to SAM3D Body.
  • The weights are under the SAM License.

v1.0.0

Choose a tag to compare

@jtydhr88 jtydhr88 released this 07 Nov 13:37

First release.

  • Load InstantHMR Model and Run InstantHMR Prediction: a 3D MHR body for every person in a photo or video (boxes from RT-DETR or tracks from SAM3), on the native SAM 3D Body nodes for smoothing, rendering and GLB / BVH export.
  • InstantHMR Live Capture: live 2D and 3D preview from this device's webcam or a phone on the same network (QR code), drives a rigged FBX / glTF / VRM character, streams to VMC apps (Blender with VMC Link, VSeeFace, Warudo), and records clips for the full pipeline.
  • Example workflows for images, video and live capture.
  • Weights: https://huggingface.co/jtydhr88/ComfyUI-InstantHMR (put them in models/detection).