The Image Enhancement Zoo

By Yansheng Qiu, Kui Jiang

Description

• Image Enhancement Zoo: A list of deraining, dehazing and brightening methods. Papers, codes and datasets are maintained.
• Thanks for the sharing of Resources for Low Light Image Enhancement, low-light-image-enhancment, DehazeZoo and DerainZoo.

2 Image Quality Metrics

• PSNR (Peak Signal-to-Noise Ratio) [paper] [matlab code] [python code]
• SSIM (Structural Similarity) [paper] [matlab code] [python code]
• VIF (Visual Quality) [paper] [matlab code]
• FSIM (Feature Similarity) [paper] [matlab code]
• NIQE (Naturalness Image Quality Evaluator) [paper] [matlab code] [python code]

Brightening

Datasets

• VV, LIME, NPE-series, DICM, MEF

  • only low-light images without corresponding high-light ground truth
  • Download
  • Thanks to baidut for collection

• ExDARK

  • only low-light image without corresponding high-light ground truth
  • [paper] [Homepage]

• LOL

  • old: [papper] [Homepage]
  • new: [dataset baidu:r0xd]

• SID [paper] [Homepage]

• MIT-Adobe FiveK [paper] [Homepage]

• SICE [paper] [Homepage]

• ELD [paper] [Homepage]

• VIP-LowLight [Homepage]

• ReNOIR [paper] [Homepage]

• DPED [paper] [Homepage]

Papers

2020

• [RLI-DaE] Learning to Restore Low-Light Images via Decomposition-and-Enhancement (CVPR 2020) [paper]

• [Pb-NFM] A Physics-based Noise Formation Model for Extreme Low-light Raw Denoising (CVPR 2020, paper for ELD dataset) [paper][code]

• [DALE] DALE : Dark Region-Aware Low-light Image Enhancement (BMVC 2020) [paper [code]

• [LLPackNet] Towards Fast and Light-Weight Restoration of Dark Images (BMVC 2020) [paper][code]

• [Zero-DCE] Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement (CVPR 2020) [paper][homepage][code]

• [DRBN] From Fidelity to Perceptual Quality: A Semi-Supervised Approach for Low-Light Image Enhancement (CVPR 2020) [paper][code]

• [LR3M] LR3M: Robust Low-Light Enhancement via Low-Rank Regularized Retinex Model (TIP 2020) [paper]

• [DRBN] From Fidelity to Perceptual Quality: A Semi-Supervised Approach for Low-Light Image Enhancement (CVPR 2020) [paper] [code]

• [STARnet] Space-Time-Aware Multi-Resolution Video Enhancement (CVPR 2020) [homepage] [code] [paper]

• [DeepLPF] DeepLPF: Deep Local Parametric Filters for Image Enhancement (CVPR 2020) [code] [paper]

• [STAR] STAR: A Structure and Texture Aware Retinex Model (TIP2020) [code] [paper]

• [MIRNet] Learning Enriched Features for Real Image Restoration and Enhancement (ECCV 2020) [paper] [code]

• [CSRnet] Conditional Sequential Modulation for Efficient Global Image Retouching (ECCV 2020) [paper] [code]

• [Flickr] Unpaired Image Enhancement with Quality-Attention Generative Adversarial Network (ACM MM 2020) [paper]

• [RT-VENet] RT-VENet: A Convolutional Network for Real-time Video Enhancement (ACM MM 2020) [paper]

• Integrating Semantic Segmentation and Retinex Model for Low Light Image Enhancement (ACM MM 2020) [paper] [homepage] [dataset google or baidu:2wml]

• Low-Light Image Enhancement with Semi-Decoupled Decomposition (TMM 2020) [paper] [code]

• Learning to Restore Low-Light Images via Decomposition-and-Enhancement (CVPR 2020) [paper]

2019

• [EnlightenGAN] EnlightenGAN: Deep Light Enhancement without Paired Supervision [paper][code]

• [DCGANs] Deep Learning for Robust end-to-end Tone Mapping (BMVC 2019) [paper]

• [RJI] Robust Joint Image Reconstruction from Color and Monochrome Cameras (BMVC 2019) [paper]

• [KinD] Kindling the Darkness: A Practical Low-light Image Enhancer (ACM MM 2019) [paper] [code]

• [DeepUPE] Underexposed Photo Enhancement using Deep Illumination Estimation (CVPR 2019) [paper][code (only test)]

• [EEMEFN] EEMEFN: Low-Light Image Enhancement via Edge-Enhanced Multi-Exposure Fusion Network (AAAI 2019) [paper] [code]

• [ALSM] Low-Light Image Enhancement via the Absorption Light Scattering Model (TIP 2019) [paper [code]

• Low-Light Image Enhancement via a Deep Hybrid Network (TIP 2019) [paper]

• Enhancing Low Light Videos by Exploring High Sensitivity Camera Noise (ICCV 2019) [paper]

2018

• [MBLLEN] MBLLEN: Low-light Image/Video Enhancement Using CNNs (BMVC 2018) [paper][code]

• [GLADNet] GLADNet: Low-Light Enhancement Network with Global Awareness (FG 2018) [paper][code]

• [Retinex-Net] Deep Retinex Decomposition for Low-Light Enhancement (BMVC 2018) [paper][code][code-pytorch]

• [SID] Learning to See in the Dark (CVPR 2018) [paper][code][code-pytorch]

• [MBLLEN] MBLLEN: Low-light Image/Video Enhancement Using CNNs (BMVC 2018) [[homepage] [code] [paper]

• [SICE] Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images (TIP 2018) [code] [paper]

• [White-Box] Exposure: A White-Box Photo Post-Processing Framework (TOG 2018) [code] [paper]

• Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model (TIP 2018) [code] [paper]

before

• [HDRNet] Deep Bilateral Learning for Real-Time Image Enhancement (SIGGRAPH 2017) [paper][code]

• [LLCNN] LLCNN: A convolutional neural network for low-light image enhancement (VCIP 2017) [paper][code]

• [LIME] LIME: Low-Light Image Enhancement via Illumination Map Estimation (TIP 2017) and LIME: A Method for Low-light IMage Enhancement (ACM MM 2016)[homepage] [Code_official] [Code1] [Code2] [Code3] [paper]

• [JieP] A Joint Intrinsic-Extrinsic Prior Model for Retinex (ICCV 2017) [homepage] [code] [paper]

• A New Low-Light Image Enhancement Algorithm Using Camera Response Model (ICCVW 2017) [Code] [Pdf]

• DSLR Quality Photos on Mobile Devices with Deep Convolutional Networks (ICCV 2017) [paper]

• [SRIE] A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation (TIP 2015) and A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation(CVPR 2016)[Pdf_1] [Pdf_2] [Code_1] [Code_2]

Dehazing

Datasets

• 3R [paper][dataset]

• KITTI [paper][dataset]

• RESIDE [paper][dataset]

• HazeRD [paper][dataset]

• SceneNet [paper][dataset]

• I-HAZE [paper][dataset]

• O-HAZE [paper][dataset]

• D-HAZY [paper][dataset]

• Middlebury [paper][dataset]

• 3DRealisticScene [paper][dataset]

• NYU Depth Dataset V2 [paper][dataset]

Papers

2020

• [PFDN] Physics-based Feature Dehazing Networks (ECCV 2020) [paper]

• [HardGAN] HardGAN: A Haze-Aware Representation Distillation GAN for Single Image Dehazing (ECCV 2020) [paper][code]

• [Dehaze-GLCGAN] Dehaze-GLCGAN: Unpaired Single Image De-hazing via Adversarial Training [paper]

• [ND-Net] Nighttime Dehazing with a Synthetic Benchmark (ACM MM 2020)[paper][code]

• [MI-Net] Implicit Euler ODE Networks for Single-Image Dehazing (CVPRW 2020) [paper]

• [BidNet] BidNet: Binocular Image Dehazing without Explicit Disparity Estimation (CVPR 2020) [paper]

• [MSBDN] Multi-Scale Boosted Dehazing Network with Dense Feature Fusion (CVPR 2020) [paper][code]

• [DA_dahazing] Domain Adaptation for Image Dehazing (CVPR 2020) [paper][code][homepage]

• [FD-GAN] FD-GAN: Generative Adversarial Networks with Fusion-discriminator for Single Image Dehazing (AAAI 2020) [paper][code]

• [FFA-Net] FFA-Net: Feature Fusion Attention Network for Single Image Dehazing (AAAI 2020) [paper][code]

• Accurate Transmission Estimation for Removing Haze and Noise from a Single Image (TIP 2020) [paper]

• Single Image Dehazing via Multi-Scale Convolutional Neural Networks with Holistic Edges (IJCV 2020) [paper]

• Fast Deep Multi-patch Hierarchical Network for Nonhomogeneous Image Dehazing (CVPRW 2020) [paper]

• Transmission Map and Atmospheric Light Guided Iterative Updater Network for Single Image Dehazing (CVPR 2020) [paper][code]

• Color Cast Dependent Image Dehazing via Adaptive Airlight Refinement and Non-linear Color Balancing (TSVT 2020)[paper][code]

2019

• [GridDehazeNet] GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing (ICCV 2019) [paper][code]

• [FastNet] Feature Forwarding for Efficient Single Image Dehazing (CVPRW 2019)[paper]

• [Cycle-Defog2Refog] End-to-End Single Image Fog Removal using Enhanced Cycle Consistent Adversarial Networks (TIP 2019) [paper]

• [VDHNet] Deep Video Dehazing with Semantic Segmentation (TIP 2019) [paper]

• Learning Interleaved Cascade of Shrinkage Fields for Joint Image Dehazing and Denoising (TIP 2019) [paper]

• Semi-Supervised Image Dehazing (TIP 2019) [paper]

• Benchmarking Single Image Dehazing and Beyond (TIP 2019) [paper][homepage]

2018

• [GFN] Gated Fusion Network for Single Image Dehazing (CVPR 2018) [paper][code][homepage]

• [FEED-Net] FEED-Net: Fully End-To-End Dehazin (ICME 2018) [paper]

• [DCPDN] Densely Connected Pyramid Dehazing Network (CVPR 2018) [paper][code]

• [Cycle-Dehaze] Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing (CVPRW 2018) [paper]

• Towards Perceptual Image Dehazing by Physics-based Disentanglement and Adversarial Training (AAAI 2018) [paper]

Before

• [AOD-Net] An All-in-One Network for Dehazing and Beyond (ICCV 2017) [paper][code][homepage]

• [DehazeNet] DehazeNet: An end-to-end system for single image haze removal (TIP 2016) [paper][code][homepage]

• A fast single image haze removal algorithm using color attenuation prior (TIP 2015) [paper]

• Single Image Dehazing via Multi-Scale Convolutional Neural Networks (ECCV 2016) [paper][code][homepage]

• Single Image Haze Removal Using Dark Channel Prior (CVPR 2009) [paper]

Deraining

Datasets

Synthetic Datasets

• Rain12 [paper][dataset]
• Rain100L_old_version [paper][dataset]
  • Rain100L_new_version [paper][dataset]
• Rain100H_old_version [paper][dataset]
  • Rain100H_new_version [paper][dataset]
• Rain800 [paper][dataset]
• Rain1200 [paper][dataset]
• Rain1400 [paper][dataset]
• Heavy Rain Dataset [paper][dataset]

Real-world Datasets

• Practical_by_Yang [paper][dataset]
• Practica_by_Zhang [paper][dataset]
• Real-world Paired Rain Dataset [paper][dataset]

Papers

2021

[WDNet]

• [DualGCN] Rain Streak Removal via Dual Graph Convolutional Network (AAAI 2021) [paper][code][homepage]

2020

• [WDNet] Wavelet-Based Dual-Branch Network for Image Demoir´eing (ECCV 2020) [paper]

• [Rethinking Image Deraining] Rethinking Image Deraining via Rain Streaks and Vapors (ECCV 2020) [paper][code][homepage]

• [JDNet] Joint Self-Attention and Scale-Aggregation for Self-Calibrated Deraining Network (ACM MM 2020) [paper][code][homepage]

• [DCSFN] DCSFN: Deep Cross-scale Fusion Network for Single Image Rain Removal (ACM MM 2020) [paper][code][homepage]

• [CVID] Conditional Variational Image Deraining (TIP 2020) [paper][code][homepage]

• [DRD-Net] Detail-recovery Image Deraining via Context Aggregation Networks (CVPR 2020) [paper][homepage][code]

• [RCDNet] A Model-driven Deep Neural Network for Single Image Rain Removal (CVPR 2020) [paper][code]

• [Syn2Rel] Syn2Real Transfer Learning for Image Deraining using Gaussian Processes (CVPR 2020) [paper][homepage][code]

• [MSPFN] Multi-Scale Progressive Fusion Network for Single Image Deraining (CVPR 2020) [paper][code][homepage]

• [VID] Variational Image Deraining (WACV 2020) [paper][homepage]

• [CMGD] (TIP 2020) [paper][homepage]

2019

• Single Image Deraining: From Model-Based to Data-Driven and Beyond (TPAMI 2019) [paper]

• [RWL] Scale-Free Single Image Deraining Via VisibilityEnhanced Recurrent Wavelet Learning (TIP 2019) [paper]

• A Survey on Rain Removal from Video and Single Image [paper][code]

• [ERL-Net] ERL-Net: Entangled Representation Learning for Single Image De-Raining (ICCV 2019) [paper][code]

• [ReHEN] Single Image Deraining via Recurrent Hierarchy and Enhancement Network (ACM MM 2019) [paper][code][homepage]

• [DTDN] DTDN: Dual-task De-raining Network (ACM MM 2019) [paper]

• [GraNet] Gradual Network for Single Image De-raining (ACM MM 2019) [paper]

• [Dual-ResNet] Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restoration (CVPR 2019) [paper][code]

• [Heavy Rain Image Restoration] Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learning (CVPR 2019) [paper][code][dataset]

• [SPANet] Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset (CVPR 2019) [paper][code][homepage][dataset]

• [Comprehensive Benchmark Analysis] Single Image Deraining: A Comprehensive Benchmark Analysis (CVPR 2019) [paper][code][dataset]

• [DAF-Net] Depth-attentional Features for Single-image Rain Removal (CVPR 2019) [paper][code][homepage]

• [Semi-supervised Transfer Learning] Semi-supervised Transfer Learning for Image Rain Removal (CVPR 2019) [paper][code]

• [PReNet] Progressive Image Deraining Networks: A Better and Simpler Baseline (CVPR 2019) [paper][code]

• [UMRL-using-Cycle-Spinning] Uncertainty Guided Multi-Scale Residual Learning-using a Cycle Spinning CNN for Single Image De-Raining (CVPR 2019) [paper][code][homepage]

• [RR-GAN] RR-GAN: Single Image Rain Removal Without Paired Information (AAAI 2019) [paper]

• [D3R-Net] D3R-Net: Dynamic Routing Residue Recurrent Network for Video Rain Removal (TIP 2019) [paper]

2018

• [GCAN] Gated Context Aggregation Network for Image Dehazing and Deraining (WACV 2018) [paper][code]

• [RESCAN] Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining (ECCV 2018) [paper][code][web]

• [RGFFN] Residual-Guide Feature Fusion Network for Single Image Deraining (ACM MM 2018) [paper]

• [NLEDN] Non-locally Enhanced Encoder-Decoder Network for Single Image De-raining (ACM MM 2018) [paper][code]

• [DualCNN] Learning Dual Convolutional Neural Networks for Low-Level Vision (CVPR 2018) [paper][code][web]

• [Attentive GAN] Attentive Generative Adversarial Network for Raindrop Removal from a Single Image (CVPR 2018) (tips: this research focuses on reducing the effets form the adherent rain drops instead of rain streaks removal) [paper][code] [homepage] [project] [reimplement code]

• [DID-MDN] Density-aware Single Image De-raining using a Multi-stream Dense Network (CVPR 2018) [paper][code][homepage]

• [Directional global sparse model] A directional global sparse model for single image rain removal (ACM MM 2018) [paper][code][homepage]

• [MSCSC] Video Rain Streak Removal By Multiscale ConvolutionalSparse Coding (CVPR 2018) [paper][code][homepage][video]

• [CNN Framework] Robust Video Content Alignment and Compensation for Rain Removal in a CNN Framework (CVPR 2018) [paper][homepage Chen][homepage Chau]

• [Erase or Fill] Erase or Fill? Deep Joint Recurrent Rain Removal and Reconstruction in Videos (CVPR 2018) [paper][code][homepage Liu] [homepage Yang]

2017

• [Transformed Low-Rank Model] Transformed Low-Rank Model for Line Pattern Noise Removal (ICCV 2017) [paper]

• [JBO] Joint Bi-layer Optimization for Single-image Rain Streak Removal (ICCV 2017) [paper][homepage]

• [JCAS] Joint Convolutional Analysis and Synthesis Sparse Representation for Single Image Layer Separation (ICCV 2017) [paper][code]homepage]

• [DDN] Removing rain from single images via a deep detail network (CVPR 2017) [paper] [code][homepage]

• [JORDER] Deep joint rain detection and removal from a single image (CVPR 2017) [paper] [code][homepage]

• [Hierarchical Approach] A Hierarchical Approach for Rain or Snow Removing in a Single Color Image (TIP 2017) [paper]

• [Clearing The Skies] Clearing the skies: A deep network architecture for single-image rain removal (TIP 2017) [paper][code][homepage]

• [MoG] Should We Encode Rain Streaks in Video as Deterministic or Stochastic? (ICCV 2017) [paper][code][homepage]

• [FastDeRain] A novel tensor-based video rain streaks removal approach via utilizing discriminatively intrinsic priors (CVPR 2017) [paper][code]

• [Matrix Decomposition] Video Desnowing and Deraining Based on Matrix Decomposition (CVPR 2017) [paper]

2015-2016

• [LP(GMM)] Rain streak removal using layer priors (CVPR 2016) [paper] Single Image Rain Streak Decomposition Using Layer Priors (TIP 2017) [dataset] [homepage]

• [DSC] Removing rain from a single image via discriminative sparse coding (ICCV 2016) [paper][code]

• [Window Covered] Restoring An Image Taken Through a Window Covered with Dirt or Rain (ICCV 2013) [paper][code]

• [Image Decomposition] Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition (TIP 2012)paper][code]

• [Adherent Raindrop Modeling] Adherent raindrop modeling, detectionand removal in video (TPAMI 2016) [paper][homepage]

• [Low-rank Matrix Completion] Video deraining and desnowing using temporal correlation and low-rank matrix completion (TIP 2015) [paper][code]

• [Utilizing Local Phase Information] Utilizing local phase information to remove rain from video (IJCV 2015) [paper]