Semantic Image Synthesis via Adversarial Learning
This is a PyTorch implementation of the paper Semantic Image Synthesis via Adversarial Learning.
- PyTorch 0.2
- fastText.py (Note: if you have a problem when loading a pretrained model, try my fixed code)
Pretrained word vectors for fastText
The caption data is from this repository. After downloading, modify
CONFIG file so that all paths of the datasets point to the data you downloaded.
Train a visual-semantic embedding model using the method of Kiros et al..
Train a GAN using a pretrained text embedding model.
Generate some examples using original images and semantically relevant texts.
We would like to thank Hao Dong, who is one of the first authors of the paper Semantic Image Synthesis via Adversarial Learning, for providing helpful advice for the implementation.