MMHuman3D Release v0.9.0

Highlights

• Support SMPL-X estimation with ExPose for simultaneous recovery of face, hands and body
• Support new body model STAR
• Release of GTA-Human dataset with SPIN-FT (51.98 mm) and PARE-FT (46.84 mm) baselines! (Official)
• Refactor registration and improve performance of SPIN to 57.54 mm

* Values are PA-MPJPE on 3DPW test

New Algorithm

• Support training and evaluation of SMPL-X estimation method ExPose
• Add a general architecture for expressive human modelling
• Add data preparation and preprocessing tools
• Add evaluation metrics

New Body Models

• Support new body model STAR by adapting the official PyTorch implementation into MMHuman3D
• Support FLAME and MANO needed by ExPose

New Dataset

• Official release of our large-scale synthetic dataset GTA-Human that contains 1.4M SMPL annotations
• Add strong baselines SPIN-FT and PARE-FT baselines, which achieve 51.98 mm and 46.84 mm PA-MPJPE on 3DPW test respectively

Refactors

• Refactor registration
  • Allow more flexible registration configurations
  • Improve performance of SPIN to 57.54 mm PA-MPJPE on 3DPW test

Documentation

• Add documation for installing MMHuman3D on Windows

Bug Fixes

• Fix missing arguments in SMPLify pipeline
• Adjust import structure in core, data and utils, removing unnecessary dependency on PyTorch3D, and achieving up to 2.6x speed-up during initialization

Many thanks to this release's contributors!

@kristijanbartol @mingyuan-zhang @Coach257 @caizhongang @LazyBusyYang @ttxskk