Skip to content
master
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
em
 
 
 
 
 
 
 
 
ssr
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

This repository implements the 3D human pose estimation algorithm introduced in the following paper:

Monocap: Monocular human motion capture using a CNN coupled with a geometric prior. X. Zhou, M. Zhu, G. Pavlakos, S. Leonardos, K.G. Derpanis, K. Daniilidis. IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), 2018. Accepted.

How to use?

  1. Download data by running the following script in command line: bash data.sh
  2. Open MATLAB and run: startup
  3. Run the demo scripts:
  • demoH36M for an example from Human3.6M dataset
  • demoHG for an example of how to use our algorithm combined with the "Stacked hourglass network"
  • demoMPII for an example of how to reconstruct 3D poses from a single image from MPII dataset

Notes:

  • The code for hourglass network in pose-hg-demo is from Newell et al., https://github.com/anewell/pose-hg-demo
  • See the comments in demoHG.m for how to run hourglass network on your images and save heatmaps
  • If you want to use the hourglass network, you need to first install Torch and make it work
  • Generally "Hourglass network" + "poseDict-all-K128" (pose dictionary learned from Human3.6M) work well. For better 3D reconstruction, you can learn a 3D pose dictionary using your own mocap data. For more details on pose dictionary learning, please see the following project: sparse representation for shape estimation
  • The optimization could be accelerated by changing the initialization method to alternating by changing the option when calling PoseFromVideo: PoseFromVideo(...,'InitialMethod','altern')

About

Code for MonoCap: Monocular Human Motion Capture using a CNN Coupled with a Geometric Prior.

Resources

License

Releases

No releases published

Packages

No packages published

Languages

You can’t perform that action at this time.