Skip to content
SC-FEGAN : Face Editing Generative Adversarial Network with User's Sketch and Color
Branch: master
Clone or download
Latest commit 43b1fc5 Mar 4, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
imgs
samples Add files via upload Feb 13, 2019
ui Update mouse_event.py Feb 20, 2019
utils Add files via upload Feb 12, 2019
.gitignore Initial commit Feb 12, 2019
LICENSE Add LICENSE file Feb 21, 2019
README.md
demo.py Update clear & fix bug Feb 20, 2019
demo.yaml
model.py
ops.py Update ops.py Mar 4, 2019

README.md

SC-FEGAN

SC-FEGAN : Face Editing Generative Adversarial Network with User's Sketch and Color

Youngjoo Jo, Jongyoul Park

arXiv: https://arxiv.org/abs/1902.06838

Teaser GUI

Overview

We learn to edit face image with a deep network. Our network SC-FEGAN is well suited to generate high quality synthetic image using intuitive user inputs with sketch and color. We used SN-patchGAN discriminator and Unet-like generator with gated convolutional layers.

Teaser Image

Dependencies

  • tensorflow
  • numpy
  • Python3
  • PyQt5
  • opencv-python
  • pyyaml

Usage

First, download the model from Google drive.

Basic usage is:

mv /${HOME}/SC-FEGAN.ckpt.* /${HOME}/ckpt/
python3 demo.py

Select the number of GPU by editing demo.yaml file (not support multi-GPUs).

GPU_NUM: 1 (the number you want to use)
#GPU_NUM: (if you want to use only CPU, erase the number)

You can use our network with simple GUI. The only erased regions are filled.

The buttons in GUI:

  • Open Image: Open the image you want to edit and reset sketch and color.
  • Mask: Click this button and draw the mask on the left viewer.
  • Sketches: Click this button and draw the line for sketch on the left viewer.
  • Color: Click this button and draw the line for color. If you click this first time, you have to choose the color from palette.
  • Palette: Click this button to change color. If you choose the color, then click the Color button to change.
  • Save Img: Click this button to save results. It is saved as 'name.jpg'.
  • Arrange: Arrange the editing works.
  • Undo: Undo previous editing work.
  • Complete: Complete the image and show it on the right.

We recommend using this in the following steps:

1. Draw the sketch plausibly referring to the original image.
2. Draw the mask on the sketched region.
3. Click the `Arrange` button.
4. Draw the color on the masked region.
5. Click `Complete'.

Example Results

Face editing

Face editing

Edit earring

Earring

Face restoration

restore1

Face restoration (with only sketch and color)

restore2

License

CC 4.0 Attribution-NonCommercial International

The software is for educational and academic research purpose only.

Notes

  • This is developed on Linux machine running Ubuntu 18.04.1
  • Provided model and sample code is under a non-commercial creative commons license.

Citing

@article{jo2019sc,
  title={SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Color},
  author={Jo, Youngjoo and Park, Jongyoul},
  journal={arXiv preprint arXiv:1902.06838},
  year={2019}
}

Next

  • Update training code

Acknowledgement

We acknowledge the official code DeepFillv1. We thank all the researchers at ETRI, especially Kimin Yun and Jinwoo Jung, for insightful discussions.

You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.