OPEC-GCN: Occluded Pose Estimation and Correction using Graph Convolutional Neural Networks
In our work, we mainly use three dataset to evaluate our considerablely results.
you can download the dataset from below link.
CrowdPose
OCHuman
MSCOCO
Firstly you should download the dataset, and then your project folder looks like follow structure. All of img_dir you can modify in config
--Crowdpose/images/...
--train2017/...
--OPEC-GCN/...
At the same time, you need download the weights of sppe and yolov3 because our OPEC-GCN depends on Alphapose as base module. So please download the models manually: duc_se.pth (2018/08/30) (Google Drive | Baidu pan), yolov3-spp.weights(Google Drive | Baidu pan). Place them into ./weights/sppe and ./weights/yolo respectively.
Considering convenience, I already processed datasets for you so that you can easily train your opec-gcn model.
download the json file manually: train_process_datasets, test_process_datasets. Place them into ./train_process_datasets and ./test_process_datasets respectively.
You can easily start to train CrowdPose dataset using following code.
CUDA_VISIBLE_DEVICES=0 python ./tools/train_alpha_pose_gcn.py --indir ../crowdpose/images/ --nEpochs 25 --trainBatch 20 --validBatch 60 --LR 1e-3 --dataset 'coco' --config ./configs/OPEC_GCN_CrowdPose_Test.py
Results on CrowdPose-test datasets:
| Methods | mAP@50:95 | AP50 | AP75 | AP80 | AP90 |
|---|---|---|---|---|---|
| AlphaPose | 67.9 | 86.0 | 72.6 | 66.8 | 45.7 |
| A+OPEC-GCN | 69.6 | 86.1 | 74.9 | 69.3 | 48.0 |
| CrowdPose | 68.5 | 86.7 | 73.2 | 66.9 | 45.9 |
| CrowdPose+OPEC-GCN | 70.2 | 86.8 | 75.4 | 69.9 | 48.4 |
Results on OCHuman datasets:
| Methods | mAP@50:95 | AP50 | AP75 | AP80 | AP90 |
|---|---|---|---|---|---|
| AlphaPose | 27.1 | 40.1 | 29.7 | 25.0 | 10.1 |
| A+OPEC-GCN | 28.3 | 40.6 | 30.8 | 26.5 | 12.1 |
| CrowdPose | 27.5 | 40.8 | 29.9 | 24.8 | 9.5 |
| CrowdPose+OPEC-GCN | 28.8 | 41.6 | 31.3 | 26.7 | 12.3 |
Results on OCPose datasets:
| Methods | mAP@50:95 | AP50 | AP75 | AP80 | AP90 |
|---|---|---|---|---|---|
| AlphaPose | 30.0 | 55.6 | 28.1 | 22.0 | 8.4 |
| A+OPEC-GCN | 31.9 | 58.6 | 30.6 | 24.1 | 9.1 |
| CrowdPose | 30.8 | 58.4 | 28.5 | 22.4 | 8.2 |
| CrowdPose+OPEC-GCN | 32.8 | 60.5 | 31.1 | 24.0 | 9.2 |
Left is current state of the art method, other side is our method.
