Secure Triplet Loss: Achieving Cancelability and Non-Linkability in End-to-End Deep Biometrics
João Ribeiro Pinto, Miguel V. Correia, and Jaime S. Cardoso
INESC TEC and Universidade do Porto, Portugal
joao.t.pinto@inesctec.pt
This repository contains the code used for our papers on the Secure Triplet Loss approach for biometric template security in end-to-end deep models. In our first paper (1), we proposed the Secure Triplet Loss, based on the original Triplet Loss (2), as a way to achieve template cancelability in deep end-to-end models without separate encryption processes. Although we succeeded in our goal, the method presented the drawback of high template linkability. Hence, in our second paper (3), we reformulated the Secure Triplet Loss to address this problem, by adding a linkability-measuring component based on Kullback-Leibler Divergence or template distance statistics. We evaluated the proposed method on biometric verification with ECG and face, and it was successful in training secure biometric models from scratch and adapting a pretrained model to make it secure.
If you want to know more about this, or if you use our code, please read and cite these papers:
J. R. Pinto, M. V. Correia, and J. S. Cardoso, "Secure Triplet Loss: Achieving Cancelability and Non-Linkability in End-to-End Deep Biometrics", in IEEE Transactions on Biometrics, Behavior, and Identity Science, 3(2): pp. 180-189, 2021.
[link] [pdf] [bib]
J. R. Pinto, J. S. Cardoso, and M. V. Correia, "Secure Triplet Loss for End-to-End Deep Biometrics", in 8th International Workshop on Biometrics and Forensics (IWBF 2020), 2020.
[link] [pdf] [bib]
This repository includes the python scripts used to train and test models with both the original triplet loss and the proposed Secure Triplet Loss. It includes scripts prepared for both face and ECG biometric verification, which used, respectively, the YouTube Faces database (YTF) (4) and the University of Toronto ECG Database (UofTDB) (5). To ensure no data from YTF or UofTDB are redistributed here, this repository does not include trained models, scores, predictions, or any other data. Nevertheless, the scripts are prepared so that anyone with access to the databases should be able to replicate our results exactly:
- Use face_prepare_ytfdb.py or ecg_prepare_uoftdb.py to prepare the face or ECG databases;
- Use [trait]_train_triplet_model.py to train a model with the original triplet loss;
- Use [trait]_train_securetl_model.py to train a model with the first formulation of the SecureTL;
- Use [trait]_train_securetl_linkability_model.py to train a model with the second formulation of the Secure TL (with Linkability);
- Use [trait]_test_triplet_model.py to test a model trained with the original triplet loss;
- Use [trait]_test_secure_model.py to test a model trained with SecureTL;
- Use results_analysis.py to print and plot various performance and security metrics of your model.
[trait] can be either face or ecg. Do not forget to set the needed variables at the beginning of each script.
To run our code, download or clone this repository and use requirements.txt to set up a pip virtual environment with the needed dependencies. You will also need the data from the YTF and UofTDB databases. The YTF aligned-images dataset can be requested on the YouTube Faces DB website. To get the UofTDB data, you should contact the BioSec.Lab at the University of Toronto.
This work was financed by the ERDF - European Regional Development Fund through the Operational Programme for Competitiveness and Internationalization - COMPETE 2020 Programme and by National Funds through the Portuguese funding agency, FCT - Fundação para a Ciência e a Tecnologia within project "POCI-01-0145-FEDER-030707", and within the PhD grant "SFRH/BD/137720/2018". The authors wish to acknowledge the creators of the UofTDB (University of Toronto, Canada), and the YouTube Faces (Tel Aviv University, Israel) databases, essential for this work.
(1) Pinto, J.R.; Cardoso, J.S.; Correia, M.V.: Secure Triplet Loss for End-to-End Deep Biometrics. 8th International Workshop on Biometrics and Forensics (IWBF 2020), 2020.
(2) Chechik, G.; Sharma, V.; Shalit, U.; Bengio, S.: Large scale onlinelearning of image similarity through ranking. Journal of Machine Learning Research, 11:1109-1135, 2010.
(3) Pinto, J.R.; Correia, M.V.; Cardoso, J.S.: J. R. Pinto, M. V. Correia, and J. S. Cardoso, "Secure Triplet Loss: Achieving Cancelability and Non-Linkability in End-to-End Deep Biometrics". IEEE Transactions on Biometrics, Behavior, and Identity Science, 3(2):180-189, 2021.
(4) Wolf, L.; Hassner, T.; Maoz, I.: Face Recognition in Unconstrained Videos with Matched Background Similarity. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011.
(5) Wahabi, S.; Pouryayevali, S.; Hari, S.; Hatzinakos, D.: On Evaluating ECG Biometric Systems: Session-Dependence and Body Posture. IEEE Transactions on Information Forensics and Security, 9(11):2002–2013, Nov 2014.