Skip to content

PeterZs/unsupervised-NDIR

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

63 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Unsupervised Non-Rigid Image Distortion Removal via Grid Deformation

Nianyi Li3,1, Simron Thapa1, Cameron Whyte2, Albert Reed2, Suren Jayasuriya2, Jinwei Ye1

1Louisiana State University, 2Arizona State University, 3Clemson University

Accepted as poster in ICCV 2021

This repository constains a demo code for our Non-rigid image distortion removal network. Our implementation is in Pytorch.

Requirements

  • Pytorch >=1.3
  • Numpy
  • PIL
  • Opencv
  • Jupyter
  • Scikit-image
  • Tqdm
  • Matplotlib
  • Torch-summary

Problem Definition

Many computer vision problems face difficulties when imaging through turbulent refractive media (e.g., air and water) due to the refraction and scattering of light. These effects cause geometric distortion that requires either handcrafted physical priors or supervised learning methods to remove.

problems

Network Architecture

In this paper, we present a novel unsupervised network to recover the latent distortion-free image. The key idea is to model non-rigid distortions as deformable grids. Our network consists of a grid deformer that estimates the distortion field and an image generator that outputs the distortion-free image.

network

By leveraging the positional encoding operator, we can simplify the network structure while maintaining fine spatial details in the recovered images.

Results

Our method doesn't need to be trained on labeled data and has good transferability across various turbulent image datasets with different types of distortions. Extensive experiments on both simulated and real-captured turbulent images demonstrate that our method can remove both air and water distortions without much customization.

Air result_new

Water result_new

Citation

@InProceedings{Li_2021_ICCV,
    author    = {Li, Nianyi and Thapa, Simron and Whyte, Cameron and Reed, Albert W. and Jayasuriya, Suren and Ye, Jinwei},
    title     = {Unsupervised Non-Rigid Image Distortion Removal via Grid Deformation},
    booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
    month     = {October},
    year      = {2021},
    pages     = {2522-2532}
}

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 99.4%
  • Python 0.6%