Toward sufficient spatial-frequency interaction for gradient-aware underwater image enhancement (ICASSP'24)
Chen Zhao, Weiling Cai, Chenyu Dong and Ziqi Zeng
Abstract: Underwater images suffer from complex and diverse degradation, which inevitably affects the performance of underwater visual tasks. However, most existing learning-based underwater image enhancement (UIE) methods mainly restore such degradations in the spatial domain, and rarely pay attention to the fourier frequency information. In this paper, we develop a novel UIE framework based on spatial-frequency interaction and gradient maps, namely SFGNet, which consists of two stages. Specifically, in the first stage, we propose a dense spatial-frequency fusion network (DSFFNet), mainly including our designed dense fourier fusion block and dense spatial fusion block, achieving sufficient spatial-frequency interaction by cross connections between these two blocks. In the second stage, we propose a gradient-aware corrector (GAC) to further enhance perceptual details and geometric structures of images by gradient map. Experimental results on two real-world underwater image datasets show that our approach can successfully enhance underwater images, and achieves competitive performance in visual quality improvement.
After preparing the training data in data/ directory, use
python train.py
to start the training of the model.
python train.py
After preparing the testing data in data/test/ directory.
python test.py
之后有空再上传预训练模型和可视化结果（谷歌云太难用了，之前弄过没弄好）。如果您喜欢我们的工作，SFGnet对您的研究能有帮助，小趴菜在这里恳请大大们引用一下~~谢谢各位路过的官人啦啦啦啦啦啦~
PS:把环境装好（非常基本非常简单），准备好数据（训练集和测试机），就可以直接运行，我在上传前已经测试过了，木有bug~~~~ PS:搞了一个晚上不知道怎么用git上床github，中间最终上传的时候一直报这个错误：fatal: unable to access 'https://github.com/zhihefang/SFGNet.git/': Failed to connect to github.com port 443 after 21076 ms: Couldn't connect to server.完全不知道怎么解决，如果有大佬知道怎么解决，留言一下（我之前上传过一次，不知道这次怎么就不行了，救命阿）。最终我是通过github网页一个个上传文件夹的。
另外，训练集的文件结构是/data/train,下面有两个子文件夹，分别是input和target。测试机是/data/test,跟训练集一样。
If you use our work, please consider citing:
@article{zhao2023toward,
title={Toward Sufficient Spatial-Frequency Interaction for Gradient-aware Underwater Image Enhancement},
author={Zhao, Chen and Cai, Weiling and Dong, Chenyu and Zeng, Ziqi},
journal={arXiv preprint arXiv:2309.04089},
year={2023}
Should you have any questions, please contact 2518628273@qq.com