A Context-assisted Single Shot Face Detector in TensorFlow
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
datasets firsr commit. Jun 25, 2018
demo Merge remote-tracking branch 'origin/master' Jun 26, 2018
eval/eval_tools first commit Jun 25, 2018
nets first commit Jun 25, 2018
preprocessing first commit Jun 25, 2018
tf_extended first commit Jun 25, 2018
utility first commit Jun 25, 2018
.gitignore first commit Jun 25, 2018
AnchorSampling.py first commit Jun 25, 2018
README.md add GoogleDrive download path Jul 10, 2018
check_data_io.py first commit Jun 25, 2018
demo.py Update demo.py Jun 26, 2018
makedir.py firsr commit. Jun 25, 2018
preparedata.py first commit Jun 25, 2018
tf_utils.py first commit Jun 25, 2018
train_model.py first commit Jun 25, 2018
widerface_eval.py firsr commit. Jun 25, 2018

README.md

PyramidBox

This is an unofficial Tensorflow re-implementation of PyramidBox: A Context-assisted Single Shot Face Detector, which achieves superior performance among the state-of-the-art on the two common face detection benchmarks, FDDB and WIDER FACE.

Note

There is still a gap in performance from the paper. May be caused by several reasons:

  • Without implementing data-anchor-sampling.
  • Differences of data augmentation from original.
  • The batch size in the paper is 16, but I used 1 because of the limitation of memory.
  • Hyperparameters not mentioned in the paper.
  • Differences of deep learning framework.

Results

Face Detection

Results on WIDER FACE validation set:

This is just a very casual training result. I believe you can achieve better results after trying some other hyperparameters. For example: batch size, learning rate and some parameters related to the loss function,etc.

Method AP Easy AP Medium AP Hard
original 96.1 95.0 88.9
this repo 90.6 88.8 73.4

Usage

Prerequisites

(Only tested on) Ubuntu 16.04 with:

  • Python3
  • Tensorflow-gpu 1.4
  • OpenCV3

Clone the repo

git clone https://github.com/EricZgw/PyramidBox.git
python makedir.py

Download PyramidBox models form BaiduYun or GoogleDrive .

Demo

Run the following script for visualization:

python demo.py

Train on WIDER FACE Datasets

  1. Download pre-trained VGG16 models from here and put it to /checkpoints.
  2. Download WIDER FACE Datasets and convert to VOC format. Path looks like below:
datasets/
       |->widerface/
       |    |->WIDER_train/
       |    |->WIDER_val/
       |    |->WIDER_test/
       |    |->Annotations/
       |    |->JPEGImages/
       |    |...
  1. Run the following script to generate TFRecords:
python datasets/pascalvoc_to_tfrecords.py
You can run `check_data_io.py` to check data. This step is not necessary.
  1. The training strategy is two-stages: First run train_model.py with below setting to train additional PyramidBox layers:
self.fine_tune_vgg16 = False
  1. Then set self.fine_tune_vgg16 =Ture to run train_model.py to train total network.

Validation

Run the following script for evaluation and get mAP:

python widerface_eval.py
cd eval/eval_tools
octave wider_eval.m

TODO

  • Add data-anchor-sampling
  • Try more logical and rigorous data augmentation
  • Transfer to other backbone networks

Reference

SSD-Tensorflow
SSD_tensorflow_VOC

Contact

If you find any problems, welcome to open a new issue or contact zhaogw93@126.com .