Cong Wang*, Xiaoying Xing*, Yutong Wu, Zhixun Su , Junyang Chen †
<* Both authors contributed equally to this research. † Corresponding author.>
This work has been accepted by ACM'MM 2020.
Rain removal is an important but challenging computer vision task as rain streaks can severely degrade the visibility of images that may make other visions or multimedia tasks fail to work. Previous works mainly focused on feature extraction and processing or neural network structure, while the current rain removal methods can already achieve remarkable results, training based on single network structure without considering the cross-scale relationship may cause information drop-out. In this paper, we explore the cross-scale manner between networks and inner-scale fusion operation to solve the image rain removal task. Specifically, to learn features with different scales, we propose a multi-sub-networks structure, where these sub-networks are fused via a cross-scale manner by Gate Recurrent Unit to inner-learn and make full use of information at different scales in these sub-networks. Further, we design an inner-scale connection block to utilize the multi-scale information and features fusion way between different scales to improve rain representation ability and we introduce the dense block with skip connection to inner-connect these blocks. Experimental results on both synthetic and real-world datasets have demonstrated the superiority of our proposed method, which outperforms over the state-of-the-art methods.
- CUDA 9.0
- Python 3.6 (or later)
- Pytorch 1.1.0
- Torchvision 0.3.0
- OpenCV
Please download the following datasets:
Please download this project through 'git' command.
$ git clone https://github.com/Ohraincu/DCSFN.git
$ cd config
Thanks to the code by Li et al., our code is also adapted based on this.
After you download the above datasets, you can perform the following operations to train:
$ python train.py
You can pause or start the training at any time because we can save the pre-trained models in due course.
[BaiduYun](pw:c3ri)
After running eval.py, you can get the corresponding numerical results (PSNR and SSIM):
$ python eval.py
If the visual results on datasets need to be observed, the show.py can be run:
$ python show.py
All the pre-trained model in each case is placed in the corresponding 'model' folder, and the 'latest_net' model is directly referenced by default.
@inproceedings{acmmm20_dcsfn,
author = {Cong Wang and Xiaoying Xing and Yutong Wu and Zhixun Su and Junyang Chen},
title = {DCSFN: Deep Cross-scale Fusion Network for Single Image Rain Removal},
booktitle = {ACM International Conference on Multimedia},
year = {2020},
}
If you are interested in our work or have any questions, please directly contact my github. Email: supercong94@gmail.com / ytongwu@mail.dlut.edu.cn