Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 

WESPE: Weakly Supervised Photo Enhancer for Digital Cameras

PyTorch implementation of paper from CVPR 2018: https://arxiv.org/abs/1709.01118

Common paper idea

This article is about the method of enhancing photos, image-to-image enhancer.

The main goal is simple: mapping from source X(bad quality pictures) to target Y(well quality pictures) in weakly supervised manner, that means we don't need a dataset of exact pairs (x, y) as in ussual supervised learning. Here is the whole architecture and it can be divided into two parts:

wespe

  • In the first part we use two generators. The first one is G: X -> enhanced_Y and the second one is F: enhaced_Y -> reconstructed_X as shown in the picture above. And then we calculate content loss based on pre-trained VGG-19 features as reconstructed_x = (F o G)(x). In simple words we try to map X into Y and make it without content loss, that's why we calculate the loss of composition of these functions.

  • In the second part we use two adversarial discriminators and total variation(for smoother results). The first one for color loss and the second one for texture loss and should learn the differences in brightness, contrast and colors. Here the idea is next: we want that enhanced pictures have similar color and texture distributions as good pictures. The final loss is a linear combination of all these losses. Authors of paper empirically found constants for losses and Gaussian blur for calculating color loss.

About

No description, website, or topics provided.

Resources

Releases

No releases published

Packages

No packages published

Languages