Skip to content

[Python] Code repository for the paper "A Deep Adversarial Framework for Visually Explainable Periocular Recognition" - CVPR 2021 Biometrics Workshop

Notifications You must be signed in to change notification settings

ojoaobrito/ExplainablePR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

42 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Interpretable Periocular Recognition

More details at www.joaopedrobrito.com/projects/explainable_pr.

[Full Paper][Workshop Slides]

Samples obtained using the proposed method

Requirements

Please install and verify the presence of the following requirements (or run pip install -r requirements.txt):

CUDA==10.1/10.2
h5py==2.8.0
imgaug==0.4.0
imutils==0.5.3
ipython==7.29.0
keras==2.2.5
lmdb==1.2.1
matplotlib==3.3.1
natsort==7.0.1
numpy==1.19.4
opencv_python==4.0.1
pillow==7.2.0
scikit_image==0.16.2
scikit_learn==1.0.1
scipy==1.7.0
setuptools==45.2.0
skimage==0.0
tensorflow==1.14.0
torch==1.3.1
torchvision==0.4.2
tqdm==4.61.2
wandb==0.12.6

Learning

All trained models and (non-synthetic) datasets are available in OneDrive.

Skip the next steps and jump to the Inference section if you do not wish to train the models again (if so, simply download the trained_models directory and replace the empty one).

Datasets

Download and unzip dataset.zip and mask_rcnn_training_and_test_dataset.zip. Then, place the resulting files from the former in the /dataset directory and the ones from the latter in the /learning/train_mask_rcnn directory.

DenseNet-161

  1. Data pre-processing

    Run the run_preprocessing.py script with the "TRAIN_CNN_DISTINGUISH_PAIRS" variable set to True:

    cd learning/prepare_dataset/
    python3 run_preprocessing.py
    
  2. Training

    Run the train_cnn.py script:

    cd learning/train_densenet_161/
    python3 train_cnn.py
    

ResNet-18

  1. Data pre-processing

    Run the run_preprocessing.py script with the "TRAIN_CNN_SIDE" variable set to True:

    cd learning/prepare_dataset/
    python3 run_preprocessing.py
    
  2. Training

    Run the train_cnn_side.py script:

    cd learning/train_resnet_18/
    python3 train_cnn_side.py
    

StyleGAN2

  1. Data pre-processing

    Run the run_preprocessing.py script with the "TRAIN_GAN_PAIRS" variable set to True:

    cd learning/prepare_dataset/
    python3 run_preprocessing.py
    
  2. Training

    Run the prepare_data.py and train_gan.py scripts:

    cd learning/train_stylegan_2/
    python3 prepare_data.py --out ./outputs/dataset/dataset.lmdb --n_worker 1 --size 256 ../../dataset/data/train/1/
    python3 train_gan.py ./outputs/dataset/dataset.lmdb/ --genuine_or_impostor G
    

Mask R-CNN

  1. Data pre-processing

    Run the preprocess_data.py script:

    cd learning/train_mask_rcnn/
    python3 preprocess_data.py
    
  2. Training

    Run the periocular_segmentation.py script:

    cd learning/train_mask_rcnn/
    python3 periocular_segmentation.py train --weights coco 
    

Inference

  1. Generating the synthetic dataset

    Run the generate_synthetic_dataset.py script:

    cd inference/code/stylegan_2
    python3 generate_synthetic_dataset.py
    
  2. Segmenting the synthetic dataset

    Run the get_segmentation_maps.py script:

    cd inference/code/stylegan_2
    python3 get_segmentation_maps.py
    
  3. Processing the synthetic dataset

    Run the process_synthetic_dataset.py script:

    cd inference/code/stylegan_2
    python3 process_synthetic_dataset.py
    
  4. Recognising and explaining a test pair

    Run the explain_pair.py script (assuming that 2 test images have been placed inside the /inference/images directory):

    cd inference
    python3 explain_pair.py
    

    The scrip above will classify the given pair as being either genuine or impostor and also return a visual explanation that, in the case of a non-match decision, serves as intrinsic justification.

Citation

If you find our code useful, please consider citing our paper:

@InProceedings{Brito_2021_CVPR,
    author    = {Brito, Joao and Proenca, Hugo},
    title     = {A Deep Adversarial Framework for Visually Explainable Periocular Recognition},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
    month     = {June},
    year      = {2021},
    pages     = {1453-1461}
}

About

[Python] Code repository for the paper "A Deep Adversarial Framework for Visually Explainable Periocular Recognition" - CVPR 2021 Biometrics Workshop

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published