This repo is a simple frontend web server for JoJoGAN

you will only have to install streamlit library to proceed.

you can add your own model by

1. adding image under style_images_aligned/ directory
2. model file under models/
3. add enum variable with the name of the file without extension in FaceOption class

by doing so, you will see your images in the left side bar and select option

Warning

• current server will save your upload image.
• be careful if you don't want it to be uploaded.

installation

• You only need to install streamlit library and what JoJoGAN requires
• pip install streamlit

RUN

running streamlit server is a bit different from normal command.

streamlit run streamlit_jojogan.py --server.port 8951

JoJoGAN: One Shot Face Stylization

This is the PyTorch implementation of JoJoGAN: One Shot Face Stylization.

Abstract:
While there have been recent advances in few-shot image stylization, these methods fail to capture stylistic details that are obvious to humans. Details such as the shape of the eyes, the boldness of the lines, are especially difficult for a model to learn, especially so under a limited data setting. In this work, we aim to perform one-shot image stylization that gets the details right. Given a reference style image, we approximate paired real data using GAN inversion and finetune a pretrained StyleGAN using that approximate paired data. We then encourage the StyleGAN to generalize so that the learned style can be applied to all other images.

Updates

• 2021-12-26 Added wandb logging. Fixed finetuning bug which begins finetuning from previously loaded checkpoint instead of the base face model. Added art model
  
• 2021-12-25 Added arcane_multi model which is trained on 4 arcane faces instead of 1 (if anyone has more clean data, let me know!). Better preserves features
  
• 2021-12-23 Paper is uploaded to arxiv.
• 2021-12-22 Integrated into Huggingface Spaces 🤗 using Gradio. Try it out
• 2021-12-22 Added pydrive authentication to avoid download limits from gdrive! Fixed running on cpu on colab.

How to use

Everything to get started is in the colab notebook.

Citation

If you use this code or ideas from our paper, please cite our paper:

@article{chong2021jojogan,
  title={JoJoGAN: One Shot Face Stylization},
  author={Chong, Min Jin and Forsyth, David},
  journal={arXiv preprint arXiv:2112.11641},
  year={2021}
}

Acknowledgments

This code borrows from StyleGAN2 by rosalinity, e4e. Some snippets of colab code from StyleGAN-NADA