Human Motion Capture

Collecting papers about human motion capture

⭐🔥💪 I will update each day and add more details about every paper ☀️☀️☀️

NOTE : Since motion capture is a field that has been studied for many years, I will collect the up to date papers first and then try to gather the old but classical one.

methods based directly on video

1. Physically Plausible Monocular 3D Motion Capture [project]
2. "Neural PhysCap" Neural Monocular 3D Human Motion Capture with Physical Awareness [project]
3. XNect: real-time multi-person 3D motion capture with a single RGB camera[project]
4. 4D Association Graph for Realtime Multi-person Motion Capture Using Multiple Video Cameras [code]
5. VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera [project]
6. TesseTrack: End-to-End Learnable Multi-Person Articulated 3D Pose Tracking [project]
7. TransPose Real-time 3D Human Translation and Pose Estimation with Six Inertial Sensors [project]
8. Real-Time Multi-person Motion Capture from Multi-view Video and IMUs[paper]
9. Synergetic Reconstruction from 2D Pose and 3D Motion for Wide-Space Multi-Person Video Motion Capture in the Wild [project]
10. MonoPerfCap: Human Performance Capture from Monocular Video [project]
11. Capturing Detailed Deformations of Moving Human Bodies [project]
12. Lightweight Multi-person Total Motion Capture Using Sparse Multi-view Cameras [project]
13. Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videos [pdf]
14. Direct Multi-view Multi-person 3D Human Pose Estimation [code]
15. Human Performance Capture from Monocular Video in the Wild [pdf]
16. Camera Distortion-aware 3D Human Pose Estimation in Video with Optimization-based Meta-Learning[pdf] | [code]
17. Human Dynamics from Monocular Video with Dynamic Camera Movements [code]
18. AirPose: Multi-View Fusion Network for Aerial 3D Human Pose and Shape Estimation [code]
19. Neural MoCon: Neural Motion Control for Physically Plausible Human Motion Capture [project]

methods based on body model such as smpl/smpl-x

Note that there are some papers that I don't list here most because I have tested it and the result is not so good(e,g. frankmocap,VIBE and so on)

1. Contact and Human Dynamics from Monocular Video [code]
2. DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Cameras [project]
3. Monocular, One-stage, Regression of Multiple 3D People [code]
4. PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop [project]
5. End-to-End Human Pose and Mesh Reconstruction with Transformers [code]
6. Pose2Pose: 3D Positional Pose-Guided 3D Rotational Pose Prediction for Expressive 3D Human Pose and Mesh Estimation[paper]
7. AGORA: Avatars in Geography Optimized for Regression Analysis [code]
8. Real-time RGBD-based Extended Body Pose Estimation [code]
9. EasyMocap [code]
10. PanoMan: Sparse Localized Components–based Model for Full Human Motions [paper]
11. Monocular Total Capture: Posing Face, Body and Hands in the Wild [code]
12. Full-body motion capture for multiple closely interacting persons [paper]
13. PARE: Part Attention Regressor for 3D Human Body Estimation [project] | [code]
14. DSFN: Dynamic Surface Function Networks for Clothed Human Bodies [code]
15. 3D Human Pose and Shape Estimation Through Collaborative Learning and Multi-view Model-fitting [code]
16. On Self-Contact and Human Pose [project]
17. KAMA: 3D Keypoint Aware Body Mesh Articulation [paper] | [video]
18. Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstruction [project]
19. Multi-person Implicit Reconstruction from a Single Image [paper] | [video]
20. Body Meshes as Points [code]
21. Collaborative Regression of Expressive Bodies using Moderation [project]
22. Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images [paper]
23. RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream [paper]
24. Monocular Real-time Full Body Capture with Inter-part Correlations [paper]
25. Learning Complex 3D Human Self-Contact [pdf]
26. Learning Local Recurrent Models for Human Mesh Recovery [pdf]
27. LASOR: Learning Accurate 3D Human Pose and Shape Via Synthetic Occlusion-Aware Data and Neural Mesh Rendering [pdf]
28. Probabilistic Modeling for Human Mesh Recovery [code]
29. Encoder-decoder with Multi-level Attention for 3D Human Shape and PoseEstimation [code]
30. LEMO: Learning Motion Priors for 4D Human Body Capture in 3D Scenes [ptoject]
31. Shape-aware Multi-Person Pose Estimation from Multi-View Images [project]
32. SPEC: Seeing People in the Wild with an Estimated Camera [project]
33. Learning to Regress Bodies from Images using Differentiable Semantic Rendering [code]
34. Mesh Graphormer [code]
35. VoteHMR: Occlusion-Aware Voting Network for Robust 3D Human Mesh Recovery from Partial Point Clouds [pdf]
36. Leveraging MoCap Data for Human Mesh Recovery [pdf]
37. PIXIE: Collaborative Regression of Expressive Bodies [code]
38. Dynamic Multi-Person Mesh Recovery From Uncalibrated Multi-View Cameras [pdf] }| [code]
39. Hierarchical Kinematic Probability Distributions for 3D Human Shape and Pose Estimation from Images in the Wild [code]
40. Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation [code]
41. Tracking People with 3D Representations [code]
42. LatentHuman: Shape-and-Pose Disentangled Latent Representation for for Human Bodies[project]
43. PoseBERT [project]
44. Camera Motion Agnostic 3D Human Pose Estimation [code]
45. GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras [project]
46. Revitalizing Optimization for 3D Human Pose and Shape Estimation: A Sparse Constrained Formulation [project]
47. ICON: Implicit Clothed humans Obtained from Normals [code]
48. Capturing Humans in Motion: Temporal-Attentive 3D Human Pose and Shape Estimation from Monocular Video [project]
49. Occluded Human Mesh Recovery [pdf]

human 3d pose estimation

1. Freemocap [code]
2. MeTRAbs: Metric-Scale Truncation-Robust Heatmaps for Absolute 3D Human Pose Estimation [code]
3. Part-aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Tracking [code]
4. Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo [code]
5. 3D Multi-Person Pose Estimation by Integrating Top-Down and Bottom-Up Networks [code]
6. CanonPose: Self-Supervised Monocular 3D Human Pose Estimation in the Wild [paper]
7. 3D Human Pose Estimation with Spatial and Temporal Transformers [code]
8. Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild [paper]
9. AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wild [code]
10. Improving Robustness and Accuracy via Relative Information Encoding in 3D Human Pose Estimation [code]
11. Probabilistic-Monocular-3D-Human-Pose-Estimation-with-Normalizing-Flows [code]
12. VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wild [pdf]
13. MetaPose: Fast 3D Pose from Multiple Views without 3D Supervision [pdf]
14. CrossFormer: Cross Spatio-Temporal Transformer for 3D Human Pose Estimation[pdf]
15. Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimation [project]

simplify optical or inertial based motion capture

1. TransPose [code]
2. Physical Inertial Poser (PIP):Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors [project]
3. EM-POSE: 3D Human Pose Estimation from Sparse Electromagnetic Trackers [code]
4. HybridCap: Inertia-aid Monocular Capture of Challenging Human Motions [pdf]

human motion capture in 3d scene

1. 4D Human Body Capture from Egocentric Video via 3D Scene Grounding [project]
2. LEMO Learning Motion Priors for 4D Human Body Capture in 3D Scenes [project]
3. Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensors [project]
4. EgoBody Dataset:Human Body Shape, Motion and Social Interactions from Head-Mounted Devices[project]
5. GOAL: Generating 4D Whole-Body Motion for Hand-Object Grasping [project]
6. HSC4D: Human-centered 4D Scene Capture in Large-scale Indoor-outdoor Space Using Wearable IMUs and LiDAR [project]
7. Human-Aware Object Placement for Visual Environment Reconstruction [project]