Skip to content

Official implementation of paper Deep Feature Rotation for Multimodal Image Style Transfer [2021 8th NAFOSTED Conference on Information and Computer Science]

License

Notifications You must be signed in to change notification settings

sonnguyen129/deep-feature-rotation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

87 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Deep Feature Rotation for Multimodal Image Style Transfer

Python 3.6 Packagist Last Commit Maintenance Contributing Ask Me Anything !

image1


This repository contains the official implementation of paper:
Deep Feature Rotation for Multimodal Image Style Transfer
Son Truong Nguyen, Nguyen Quang Tuyen, Nguyen Hong Phuc
In NICS 2021 Oral.

Paper (arXiv version) Paper (IEEE version) Presentation Colab Demo Bibtex

Table of Content

  1. Overview
  2. Getting Started
  3. Results
  4. Extensive results
  5. Citation
  6. Contact

Overview

We propose a simple method for representing style features in many ways called Deep Feature Rotation (DFR), while still achieving effective stylization compared to more complex methods in style transfer. Our approach is a representative of the many ways of augmentation for intermediate feature embedding without consuming too much computational expense.


Model architecture

Model architecture.

Getting started

Demo


Try out in Google Colab

Installation

  • Clone this repository and check the requirements.txt:

    git clone https://github.com/sonnguyen129/deep-feature-rotation
    cd deep-feature-rotation
    pip install -r requirements.txt
  • Inference:

    • Prepare your content image and style image. I provide some in the data/content and data/style and you can try to use them easily.
    • Simply run:
    python train.py --content-path <CONTENT_PATH> --style-path <STYLE_PATH>

    The test results will be saved to ./results by default.

Results

Experimental result in different rotation weight.


image4

Comparison with other methods.

Extensive results

We provide a visual comparison between other rotation angles that do not appear in the paper. The rotation angles will produce a very diverse number of outputs. This has proven the effectiveness of our method with other methods.

image4

Visual comparison in different rotation angles.

Citation

If you find this work useful for your research, please cite:

@INPROCEEDINGS{9701465,  
    author={Nguyen, Son Truong and Tuyen, Nguyen Quang and Phuc, Nguyen Hong},  
    booktitle={2021 8th NAFOSTED Conference on Information and Computer Science (NICS)},   
    title={Deep Feature Rotation for Multimodal Image Style Transfer},   
    year={2021},  
    pages={260-265},  
    doi={10.1109/NICS54270.2021.9701465}
}

Contact

If you have any questions/comments/bug reports, feel free to open a github issue or pull a request or mail to the author Son Truong Nguyen.

About

Official implementation of paper Deep Feature Rotation for Multimodal Image Style Transfer [2021 8th NAFOSTED Conference on Information and Computer Science]

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages