Skip to content
Tensorflow implementation of CycleGANs
Branch: master
Clone or download
Pull request Compare This branch is 10 commits ahead, 1 commit behind 4Catalyzer:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
configs init Jul 18, 2017
imgs
test init Jul 18, 2017
.gitignore
LICENSE init Jul 18, 2017
README.md
__init__.py init Jul 18, 2017
create_cyclegan_dataset.py init Jul 18, 2017
cyclegan_datasets.py
data_loader.py Update data_loader.py Dec 14, 2018
download_datasets.sh init Jul 18, 2017
layers.py
losses.py
main.py
model.py add skip connection between input and output Sep 27, 2017

README.md

CycleGAN in TensorFlow

[update 9/26/2017] We observed faster convergence and better performance after adding skip connection between input and output in the generator. To turn the feature on, use switch --skip=True. This is the result of turning on skip after training for 23 epochs:

This is the TensorFlow implementation for CycleGAN. The code was written by Harry Yang and Nathan Silberman.

CycleGAN: [Project] [Paper]

Introduction

This code contains two versions of the network architectures and hyper-parameters. The first one is based on the TensorFlow implementation. The second one is based on the official PyTorch implementation. The differences are minor and we observed both versions produced good results. You may need to train several times as the quality of the results are sensitive to the initialization.

Below is a snapshot of our result at the 50th epoch on one training instance:

Getting Started

Prepare dataset

  • You can either download one of the defaults CycleGAN datasets or use your own dataset.

    • Download a CycleGAN dataset (e.g. horse2zebra):
     bash ./download_datasets.sh horse2zebra
    • Use your own dataset: put images from each domain at folder_a and folder_b respectively.
  • Create the csv file as input to the data loader.

    • Edit the cyclegan_datasets.py file. For example, if you have a face2ramen_train dataset which contains 800 face images and 1000 ramen images both in PNG format, you can just edit the cyclegan_datasets.py as following:
     DATASET_TO_SIZES = {
     'face2ramen_train': 1000
     }
    
     PATH_TO_CSV = {
     'face2ramen_train': './CycleGAN/input/face2ramen/face2ramen_train.csv'
     }
    
     DATASET_TO_IMAGETYPE = {
     'face2ramen_train': '.png'
     }
    
    • Run create_cyclegan_dataset.py:
     python -m CycleGAN_TensorFlow.create_cyclegan_dataset --image_path_a=folder_a --image_path_b=folder_b --dataset_name="horse2zebra_train" --do_shuffle=0

Training

  • Create the configuration file. The configuration file contains basic information for training/testing. An example of the configuration file could be fond at configs/exp_01.json.

  • Start training:

python -m CycleGAN_TensorFlow.main \
    --to_train=1 \
    --log_dir=CycleGAN_TensorFlow/output/cyclegan/exp_01 \
    --config_filename=CycleGAN_TensorFlow/configs/exp_01.json
  • Check the intermediate results.
    • Tensorboard
     tensorboard --port=6006 --logdir=CycleGAN_TensorFlow/output/cyclegan/exp_01/#timestamp# 
    • Check the html visualization at CycleGAN_TensorFlow/output/cyclegan/exp_01/#timestamp#/epoch_#id#.html.

Restoring from the previous checkpoint.

python -m CycleGAN_TensorFlow.main \
    --to_train=2 \
    --log_dir=CycleGAN_TensorFlow/output/cyclegan/exp_01 \
    --config_filename=CycleGAN_TensorFlow/configs/exp_01.json \
    --checkpoint_dir=CycleGAN_TensorFlow/output/cyclegan/exp_01/#timestamp#

Testing

  • Create the testing dataset.
    • Edit the cyclegan_datasets.py file the same way as training.
    • Create the csv file as the input to the data loader.
     python -m CycleGAN_TensorFlow.create_cyclegan_dataset --image_path_a=folder_a --image_path_b=folder_b --dataset_name="horse2zebra_test" --do_shuffle=0
  • Run testing.
python -m CycleGAN_TensorFlow.main \
    --to_train=0 \
    --log_dir=CycleGAN_TensorFlow/output/cyclegan/exp_01 \
    --config_filename=CycleGAN_TensorFlow/configs/exp_01_test.json \
    --checkpoint_dir=CycleGAN_TensorFlow/output/cyclegan/exp_01/#old_timestamp# 

The result is saved in CycleGAN_TensorFlow/output/cyclegan/exp_01/#new_timestamp#.

You can’t perform that action at this time.