Skip to content
Project Page of 'Synthesizing Coupled 3D Face Modalities by Trunk-Branch Generative Adversarial Networks'
Branch: master
Clone or download
Latest commit df8dfb2 Sep 5, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
LICENSE Initial commit Sep 5, 2019
README.md Update README.md Sep 6, 2019
representative.png Add files via upload Sep 6, 2019

README.md

Synthesizing Coupled 3D Face Modalities by Trunk-Branch Generative Adversarial Networks

ArXiv, Full Resolution Pdf, Supplementary Video

Baris Gecer 1,2, Alexander Lattas 1,2, Stylianos Ploumpis 1,2, Jiankang Deng 1,2, Athanasios Papaioannou 1,2, Stylianos Moschoglou 1,2, & Stefanos Zafeiriou 1,2
1 Imperial College London
2 FaceSoft.io


(This documentation is still under construction, please refer to our paper for more details)

Abstract

Generating realistic 3D faces is of high importance for computer graphics and computer vision applications. Generally, research on 3D face generation revolves around linear statistical models of the facial surface. Nevertheless, these models cannot represent faithfully either the facial texture or the normals of the face, which are very crucial for photo-realistic face synthesis. Recently, it was demonstrated that Generative Adversarial Networks (GANs) can be used for generating high-quality textures of faces. Nevertheless, the generation process either omits the geometry and normals, or independent processes are used to produce 3D shape information. In this paper, we present the first methodology that generates high-quality texture, shape, and normals jointly, which can be used for photo-realistic synthesis. To do so, we propose a novel GAN that can generate data from different modalities while exploiting their correlations. Furthermore, we demonstrate how we can condition the generation on the expression and create faces with various facial expressions.


Supplementary Video

Watch the video

Citation

If you find this work is useful for your research, please cite our paper:

@ARTICLE{Gecer_2019_TBGAN,
author = {{Gecer}, Baris and {Lattas}, Alexander and {Ploumpis}, Stylianos and
         {Deng}, Jiankang and {Papaioannou}, Athanasios and
         {Moschoglou}, Stylianos and {Zafeiriou}, Stefanos},
title = "{Synthesizing Coupled 3D Face Modalities by Trunk-Branch Generative Adversarial Networks}",
journal = {arXiv e-prints},
year = "2019",
month = "Sep",
eid = {arXiv:1909.02215},
pages = {arXiv:1909.02215},
archivePrefix = {arXiv},
eprint = {1909.02215},
}

You can’t perform that action at this time.