OpenMPL

MPL: Lifting 3D Human Pose from Multi-view 2D Poses, T-CAP ECCV24

Seyed Abolfazl Ghasemzadeh, Alexandre Alahi, Christophe De Vleeschouwer

arxiv 2408.10805

Installation

To get started with OpenMPL, follow these steps:

Steps

1. Clone the Repository:

   git clone git@github.com:aghasemzadeh/OpenMPL.git
   cd OpenMPL

2. Install Dependencies:

   pip install -r requirements.txt

   Install amass framework through the following link to be able to run MHP:

   https://github.com/nghorbani/amass

   Install mmpose for running off-the-shelf 2D pose estimation:

   https://github.com/open-mmlab/mmpose

3. Datasets Setup:

   You will need AMASS dataset for training (+ camera calibrations from your test dataset) and a dataset for testing in MPL. We test our framework on two datasets: CMU and Human3.6M.

   CMU

   For CMU data, please follow panoptic-toolbox to prepare images and annotations. Then run the command below after correcting the paths:

   cd MPL/data
   sh preprocess_cmu_panoptic_all_cams.sh

   Human3.6M

   For Human36M data, please follow H36M-Toolbox to prepare images and annotations. Then run the command below after correcting the paths:

   cd MPL/data
   sh preprocess_h36m.sh

   AMASS

   For running MHP (generating 3D dataset for MPL), you need to download the amass dataset. Please follow AMASS for downloading the pose SMPL data. For running MHP, you will need to install amass framework and follow their guidelines.

   After correcting the paths, you can run the command below:

   cd MPH
   sh run_mmpose_00_cmu_calibs.sh      # for CMU
   sh run_mmpose_00_h36m_calibs.sh     # for Human3.6M

   Remember to go through the code in these files to be sure you run everything. There are some parallel scripts that you need to take care yourself. (Some are commented)

Citation

Please make sure to cite our paper if you utilize our code.

@ARTICLE{Ghasemzadeh2024-ln,
  title         = "{MPL}: Lifting {3D} Human Pose from Multi-view {2D} Poses",
  author        = "Ghasemzadeh, Seyed Abolfazl and Alahi, Alexandre and De
                   Vleeschouwer, Christophe",
  month         =  aug,
  year          =  2024,
  copyright     = "http://creativecommons.org/licenses/by-nc-sa/4.0/",
  archivePrefix = "arXiv",
  primaryClass  = "cs.CV",
  eprint        = "2408.10805"
}

Acknowledgement

Part of our code is borrowed from PPT and PoseFormer. We thank the authors for releasing the codes.

License

This project is licensed under the MIT License - see the LICENSE file for details.

---

Happy coding! If you have any questions, feel free to open an issue or contact us directly.