Skip to content

xmichelleshihx/Neural-Style-Transfer-Papers

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 

Repository files navigation

Neural-Style-Transfer-Papers :art:

Selected papers, corresponding codes and pre-trained models in our review paper "Neural Style Transfer: A Review"

(This Paper is under a major revision and the organization below may not be consistent with the original paper. We will release the newest version of the paper ASAP. Any comment is welcomed! Thank you very much!)

If I missed your paper in this review, please email me. I will appreciate your help. Thanks!

Citation

If you find this repository useful for your research, please cite

@article{jing2017neural,
  title={Neural Style Transfer: A Review},
  author={Jing, Yongcheng and Yang, Yezhou and Feng, Zunlei and Ye, Jingwen and Yu, Yizhou and Song, Mingli},
  journal={arXiv preprint arXiv:1705.04058},
  year={2017}
}

News!

  • [Feb, 2018] Update the Images (Images_neuralStyleTransferReview_v2) in the Materials. Add the results of Li et al.'s NIPS 2017 paper.

  • [Jan, 2018] Pre-trained models and all the content images, the style images, and the stylized results in the paper have been released.

Materials corresponding to Our Paper

Supplementary Materials

Pre-trained Models

Images (v2)

A Taxonomy of Current Methods

1. "Slow" Neural Methods Based On Image Optimization

1.1. Parametric "Slow" Neural Methods with Summary Statistics

✅ [A Neural Algorithm of Artistic Style] [Paper] (First Neural Style Transfer Paper)

❇️ Code:

✅ [Image Style Transfer Using Convolutional Neural Networks] [Paper] (CVPR 2016)

✅ [Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses] [Paper]

✅ [Demystifying Neural Style Transfer] [Paper] (Theoretical Explanation) (IJCAI 2017)

❇️ Code:

✅ [Content-Aware Neural Style Transfer] [Paper]

✅ [Towards Deep Style Transfer: A Content-Aware Perspective] [Paper] (BMVC 2016)

✅ [Incorporating Long-range Consistency in CNN-based Texture Generation] [Paper] (ICLR 2017)

❇️ Code:

✅ [Laplacian-Steered Neural Style Transfer] [Paper] (ACM MM 2017)

❇️ Code:

1.2. Non-parametric "Slow" Neural Methods with MRFs

✅ [Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis] [Paper] (CVPR 2016)

❇️ Code:

✅ [Neural Doodle_Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artwork] [Paper]

2. "Fast" Neural Methods Based On Model Optimization

2.1. Per-Style-Per-Model "Fast" Neural Methods

✅ [Perceptual Losses for Real-Time Style Transfer and Super-Resolution] [Paper] (ECCV 2016)

❇️ Code:

❇️ Pre-trained Models:

✅ [Texture Networks: Feed-forward Synthesis of Textures and Stylized Images] [Paper] (ICML 2016)

❇️ Code:

✅ [Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis] [Paper] (CVPR 2017)

❇️ Code:

✅ [Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks] [Paper] (ECCV 2016)

❇️ Code:

✅ [Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer] [Paper] (CVPR 2017)

2.2. Multiple-Style-Per-Model "Fast" Neural Methods

✅ [A Learned Representation for Artistic Style] [Paper] (ICLR 2017)

❇️ Code:

✅ [Multi-style Generative Network for Real-time Transfer] [Paper]  (arXiv, 03/2017)

❇️ Code:

✅ [StyleBank: An Explicit Representation for Neural Image Style Transfer] [Paper] (CVPR 2017)

✅ [Diversified Texture Synthesis With Feed-Forward Networks] [Paper] (CVPR 2017)

❇️ Code:

2.3. Arbitrary-Style-Per-Model "Fast" Neural Methods

✅ [Fast Patch-based Style Transfer of Arbitrary Style] [Paper]

❇️ Code:

✅ [Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization] [Paper] (ICCV 2017)

❇️ Code:

✅ [Universal Style Transfer via Feature Transforms] [Paper] (NIPS 2017)

❇️ Code:

Slight Modifications of Current Methods

1. Modifications of "Slow" Neural Methods

✅ [Exploring the Neural Algorithm of Artistic Style] [Paper]

✅ [Improving the Neural Algorithm of Artistic Style] [Paper]

✅ [Preserving Color in Neural Artistic Style Transfer] [Paper]

✅ [Controlling Perceptual Factors in Neural Style Transfer] [Paper] (CVPR 2017)

❇️ Code:

2. Modifications of "Fast" Neural Methods

✅ [Instance Normalization:The Missing Ingredient for Fast Stylization] [Paper]

❇️ Code:

✅ [Depth-Preserving Style Transfer] [Paper]

❇️ Code:

✅ [Depth-Aware Neural Style Transfer] (NPAR 2017)

Extensions

✅ [Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artwork] [Paper]

❇️ Code:

✅ [Painting Style Transfer for Head Portraits Using Convolutional Neural Networks] [Paper] (SIGGRAPH 2016)

✅ [Son of Zorn's Lemma Targeted Style Transfer Using Instance-aware Semantic Segmentation] [Paper] (ICASSP 2017)

✅ [Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN] [Paper] (ACPR 2017)

✅ [Artistic Style Transfer for Videos] [Paper] (GCPR 2016)

❇️ Code:

✅ [DeepMovie: Using Optical Flow and Deep Neural Networks to Stylize Movies] [Paper]

✅ [Characterizing and Improving Stability in Neural Style Transfer] [Paper]) (ICCV 2017)

✅ [Coherent Online Video Style Transfer] [Paper] (ICCV 2017) (First end-to-end video style transfer?)

✅ [Real-Time Neural Style Transfer for Videos] [Paper] (CVPR 2017)

✅ [Deep Photo Style Transfer] [Paper] (CVPR 2017)

❇️ Code:

✅ [Decoder Network Over Lightweight Reconstructed Feature for Fast Semantic Style Transfer] [Paper] (ICCV 2017)

Application

Prisma

Ostagram

❇️ Code:

Deep Forger

Application Papers

✅ [Bringing Impressionism to Life with Neural Style Transfer in Come Swim] [Paper]

✅ [Imaging Novecento. A Mobile App for Automatic Recognition of Artworks and Transfer of Artistic Styles] [Paper]

Blogs

✅ [Caffe2Go][https://code.facebook.com/posts/196146247499076/delivering-real-time-ai-in-the-palm-of-your-hand/]

✅ [Supercharging Style Transfer][https://research.googleblog.com/2016/10/supercharging-style-transfer.html]

✅ [Issue of Layer Chosen Strategy][http://yongchengjing.com/pdf/Issue_layerChosenStrategy_neuralStyleTransfer.pdf]

✅ [Picking an optimizer for Style Transfer][https://blog.slavv.com/picking-an-optimizer-for-style-transfer-86e7b8cba84b]

Exciting New Directions

Character Style Transfer

  • [Awesome Typography: Statistics-based Text Effects Transfer][Paper] (CVPR 2017)

❇️ Code:

Visual Attribute Transfer through Deep Image Analogy[Paper] (SIGGRAPH 2017)

❇️ Code:

Fashion Style Generator [Paper] (IJCAI 2017)

Unclassified (To Be Updated Soon)

✅ [Exploring the Structure of a Real-time, Arbitrary Neural Artistic Stylization Network] [Paper] (BMVC 2017)

About

✏️ Neural Style Transfer: A Review

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published