Skip to content
📚 A collection of Deep Learning based Image Colorization and Video Colorization papers.
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
README.md Update README.md Nov 12, 2019
examples.png Add files via upload Mar 6, 2019

README.md

Awesome-Image-Colorization

Awesome

A collection of Deep Learning based Image Colorization papers and demos, including Automatic and User Guided (i.e. with User Interaction) colorization, as well as video colorization.

Feel free to create a PR or an issue.

examples

Outline


1. Automatic Image Colorization

Paper Source Code/Project Link
Learning Large-Scale Automatic Image Colorization ICCV 2015 [project] [code]
Deep Colorization ICCV 2015
Learning Representations for Automatic Colorization ECCV 2016 [project] [code]
Colorful Image Colorization ECCV 2016 [project] [code]
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification SIGGRAPH 2016 [project] [code]
Unsupervised Diverse Colorization via Generative Adversarial Networks ECML-PKDD 2017 [code]
Learning Diverse Image Colorization CVPR 2017 [code]
Structural Consistency and Controllability for Diverse Colorization ECCV 2018
Pixelated Semantic Colorization 1901.10889
Coloring With Limited Data: Few-Shot Colorization via Memory Augmented Networks CVPR 2019 [project]

Unofficial:
[code (PyTorch)]

2. User Guided Image Colorization

2.1 Based on color strokes

Image Type Paper Source Code/Project Link
Manga Manga colorization SIGGRAPH 2006
Line art / Sketch LazyBrush: Flexible Painting Tool for Hand-drawn Cartoons Eurographics 2009 [Project Home & Software]

Unofficial:
[code1 (Matlab)]
[code2 (C#)]
[code3]
Line art / Sketch Outline Colorization through Tandem Adversarial Networks 1704.08834 [Demo] [code]
Line art / Sketch Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Generative Adversarial Networks 1705.01908 [code]
Natural Gray-Scale Real-Time User-Guided Image Colorization with Learned Deep Priors SIGGRAPH 2017 [project] [code1] [code2]
Sketch Scribbler: Controlling Deep Image Synthesis with Sketch and Color CVPR 2017
Line art User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks ACM MM 2018 [code]
Line art Style2paints V3 : Two-stage Sketch Colorization SIGGRAPH Asia 2018 [Project] [Code] [Demo]

[PyTorch Reimplementation]
Natural Gray-Scale Interactive Deep Colorization Using Simultaneous Global and Local Inputs (also palette based) ICASSP 2019
Line art Paints Chainer Online Demo [Demo] [code]
Line art PaintsTensorFlow Github Repo [Code]
Manga MangaCraft Online Demo [Demo]

2.2 Based on reference color image

Image Type Paper Source Code/Project Link
Line art Style2paints V1 : Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN ACPR 2017 [Code]
Manga Comicolorization: Semi-Automatic Manga Colorization (also palette based) SIGGRAPH Asia 2017 [code]
Sketch TextureGAN: Controlling Deep Image Synthesis with Texture Patches CVPR 2018 [code]
Natural Gray-Scale Deep Exemplar-based Colorization SIGGRAPH 2018 [code]
Natural Gray-Scale Example-Based Colourization Via Dense Encoding Pyramids (also palette based) Pacific Graphics 2018 [code]
Natural Gray-Scale A Superpixel-based Variational Model for Image Colorization TVCG 2019
Natural Gray-Scale Automatic Example-based Image Colourisation using Location-Aware Cross-Scale Matching TIP 2019
Line art / Sketch Adversarial Colorization Of Icons Based On Structure And Color Conditions ACM MM 2019 [Code]

2.3 Based on color palette

Image Type Paper Source Code/Project Link
Natural Image Palette-based Photo Recoloring SIGGRAPH 2015 [project]
Manga Comicolorization: Semi-Automatic Manga Colorization (also reference based) SIGGRAPH Asia 2017 [code]
Natural Gray-Scale Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation (also text based) ECCV 2018 [code]
Natural Gray-Scale Example-Based Colourization Via Dense Encoding Pyramids (also reference based) Pacific Graphics 2018 [code]
Natural Gray-Scale Interactive Deep Colorization Using Simultaneous Global and Local Inputs (also strokes based) ICASSP 2019

2.4 Based on language or text

Image Type Paper Source Code/Project Link
Natural Gray-Scale / Sketch Language-Based Image Editing with Recurrent Attentive Models CVPR 2018 [code]
Natural Gray-Scale Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation (also palette based) ECCV 2018 [code]
Natural Gray-Scale Learning to Color from Language NAACL 2018 [code]
Line art Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss ICCV 2019 [code] [code2 (GUI)]
Scene Sketch Language-based Colorization of Scene Sketches SIGGRAPH Asia 2019 [code] [project]

3. Video Colorization

3.1 Automatically

Paper Source Code/Project Link
Fully Automatic Video Colorization with Self-Regularization and Diversity CVPR 2019 [code]

3.2 Based on reference

Paper Source Code/Project Link
Switchable Temporal Propagation Network ECCV 2018
Tracking Emerges by Colorizing Videos ECCV 2018 [code]
Deep Exemplar-based Video Colorization CVPR 2019
DeepRemaster: Temporal Source-Reference Attention Networks for Comprehensive Video Enhancement SIGGRAPH Asia 2019 [code] [project]
You can’t perform that action at this time.