Skip to content
A PyTorch implementation of the paper "Semantic Image Synthesis via Adversarial Learning" in ICCV 2017
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
examples
images
scripts initial version Aug 23, 2017
test
.gitignore
CONFIG
LICENSE Initial commit Aug 22, 2017
README.md
data.py
model.py
test.py initial version Aug 23, 2017
train.py
train_text_embedding.py

README.md

Semantic Image Synthesis via Adversarial Learning

This is a PyTorch implementation of the paper Semantic Image Synthesis via Adversarial Learning.

Model architecture

Requirements

Pretrained word vectors for fastText

Download a pretrained English word vectors. You can see the list of pretrained vectors on this page.

Datasets

The caption data is from this repository. After downloading, modify CONFIG file so that all paths of the datasets point to the data you downloaded.

Run

  • scripts/train_text_embedding_[birds/flowers].sh
    Train a visual-semantic embedding model using the method of Kiros et al..
  • scripts/train_[birds/flowers].sh
    Train a GAN using a pretrained text embedding model.
  • scripts/test_[birds/flowers].sh
    Generate some examples using original images and semantically relevant texts.

Results

Flowers

Birds

Acknowledgements

We would like to thank Hao Dong, who is one of the first authors of the paper Semantic Image Synthesis via Adversarial Learning, for providing helpful advice for the implementation.

You can’t perform that action at this time.