Skip to content

amikey/style2paints

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

STYLE2PAINTS 2.1: the Best Anime Colorization AI!

First of all, why not spend 5 minutes to try it yourself!

WebAPP: PaintsTransfer

The AI can paint on a sketch according to a given specific color style.

The AI can create its own color style to paint on a sketch.

The AI can transfer illustrations' style.

Latest News

2018.2.12 - PaintsTransfer 3.0 will be released in 2018.04.25-2018.05.15. We will use a totally non-residual very deep model.

2018.2.3 - We added the super accurate pencil, and the original pencil tool is replaced by brush. The problem of over colorization in non-reference mode is fixed when you use the super accurate pencil, and the color spreading of super accurate pencil is limited to a relative small degree.

Tutorial

Tutorial001(BiliBili)

Results with Hints

We are the most accurate anime colorization AI to obey your hints!

All results below are achieved with one reference image and some human hints.

web_preview

web_preview

web_preview

web_preview

web_preview

web_preview

web_preview

web_preview

web_preview

web_preview

web_preview

Results without Hints

We are the most creative anime colorization AI without your hints!

All results below are achieved WITHOUT any reference image or human hints.

IMPORTANT: Here the only inputs is one sketch.

IMPORTANT: NO human hint and NO reference is involved!

web_preview

web_preview

web_preview

web_preview

web_preview

web_preview

web_preview

web_preview

web_preview

Launch Server

you need a python 3.5/3.6 GPU environment with cuda.

pip install tensorflow_gpu
pip install keras
pip install bottle
pip install gevent
pip install h5py
pip install opencv-python
pip install scikit-image
git clone https://github.com/lllyasviel/style2paints.git

   (Then you need to download all models from our Google Drive and put these into 'server' folder.)    cd style2paints/server python server.py

Models

Currently, we reserve all rights about all these models.

We use Google Drive to upload models:

https://drive.google.com/open?id=1fWi4wmNj-xr-nCzuWMsN2rcm0249_Aem

Current model list of the 8 neural networks:

base_head.net
dull_head.net
gate_head.net
line_head.net
base_neck.net
clear_tail.net
noise_tail.net
base_reader.net

Training Datasets

  1. The recommended training dataset of illustrations is the 400k images from nico-opendata

  2. The recommended training sketches is from sketchKeras

Community

QQ Group ID: 184467946

Acknowledgements

Thanks a lot to TaiZan. This project could not be achieved without his great help.