Blind Non-Uniform Motion Deblurring using Atrous Spatial Pyramid Deformable Convolution and Deblurring-Reblurring Consistency
Code for this paper Blind Non-Uniform Motion Deblurring using Atrous Spatial Pyramid Deformable Convolution and Deblurring-Reblurring Consistency
Dong Huo, Abbas Masoumzadeh, Yee-Hong Yang
Many deep learning based methods are designed to remove non-uniform (spatially variant) motion blur caused by object motion and camera shake without knowing the blur kernel. Some methods directly output the latent sharp image in one stage, while others utilize a multi-stage strategy (\eg multi-scale, multi-patch, or multi-temporal) to gradually restore the sharp image. However, these methods have the following two main issues: 1) The computational cost of multi-stage is high; 2) The same convolution kernel is applied in different regions, which is not an ideal choice for non-uniform blur. Hence, non-uniform motion deblurring is still a challenging and open problem. In this paper, we propose a new architecture which consists of multiple Atrous Spatial Pyramid Deformable Convolution (ASPDC) modules to deblur an image end-to-end with more flexibility. Multiple ASPDC modules implicitly learn the pixel-specific motion with different dilation rates in the same layer to handle movements of different magnitude. To improve the training, we also propose a reblurring network to map the deblurred output back to the blurred input, which constrains the solution space. Our experimental results show that the proposed method outperforms state-of-the-art methods on the benchmark datasets.
The datasets for training can be downloaded via the links below:
- Python 3.8
- PyTorch 1.9.0
- mmcv-full 1.3.9
- Requirements: opencv-python, albumentations
- Platforms: Ubuntu 20.04, RTX 2080 Ti, cuda-11.1
python DR_training.py
Modify the arguments in parse_args()
python D_testing.py
Download the well-trained models in folder /final_model
- ReBlurringNet.pth: the model of reblurring network
- DeblurringNet_NF.pth: the model of deblurring network without fine-tuning
- DeblurringNet_NF.pth: the model of deblurring network fine-tuned with reblurring loss
Baidu netdisk users can also download the model from link with password: tkc9
If you use this code for your research, please cite our paper.
@InProceedings{Huo_2022_CVPR,
author = {Huo, Dong and Masoumzadeh, Abbas and Yang, Yee-Hong},
title = {Blind Non-Uniform Motion Deblurring Using Atrous Spatial Pyramid Deformable Convolution and Deblurring-Reblurring Consistency},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2022},
pages = {437-446}
}