Skip to content
Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformation (CVPR2019 Oral)
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
datasets remove the importation of uncalled functions Apr 16, 2019
demo first commit Apr 10, 2019
predef first commit Apr 10, 2019
src add missing functions for data preparation part Apr 16, 2019
LICENSE first commit Apr 10, 2019
README.md first commit Apr 10, 2019
conf.ini
requirements.txt first commit Apr 10, 2019

README.md

Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformation

Hao Zhu, Xinxin Zuo, Sen Wang, Xun Cao, Ruigang Yang     CVPR 2019 Oral

[project page]     [paper]

From green bounded frame: source image --> initial guess --> joint deform --> anchor deform --> vertex deform

Requirements

The project is tested on ubuntu 16.04 with python 2.7, PyTorch 1.0. We recomend using Anaconda to create a new enviroment:

conda create -n py27-hmd python=2.7
conda activate py27-hmd

Install dependecies:

sudo apt-get install libsuitesparse-dev
pip install -r requirements.txt

The installation of OpenDR is unstable now, we recommend using a old stable version:

pip install pip==8.1.1
pip install opendr==0.76
pip install --upgrade pip

Refer to the guide to install the PyTorch 1.0.

Demo

Download the pretrained model:

cd demo
chmod +x download_pretrained_model.sh
./download_pretrained_model.sh

Run the demo:

python demo.py --ind 2 # or 477, 2040, 2726

The results will be saved in the folder "demo/results/" by default. Run "python demo.py -h" for more usages.

This repository merely contains 4 samples for demo. To run the full test data, download the test set from Google Drive or Baidu Cloud(extracting code:0ch3). Extract the test set and change the "dataset_path" in "conf.ini" to the extracted location. The range of test data number is [0-4624]. You can also follow the instructions in the "Data preparation" part to generate testing data together with training data.

In the generation of the dataset, we predicted the initial mesh using HMR and saved it as "/para/*.json" files. To test on images beyond the dataset, you have to run HMR to get the initial mesh firstly. The demo for images beyond the test set will be added in the near future.

Data preparation

Please see the datasets/data.md.

Citation

If you find this project useful for your research, please consider citing:

@inproceedings{zhu2019detailed,
  title={Detailed human shape estimation from a single image by hierarchical mesh deformation},
  author={Zhu, Hao and Zuo, Xinxin and Wang, Sen and Cao, Xun and Yang, Ruigang},
  booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  year={2019}
}
You can’t perform that action at this time.