Skip to content

jianzhangcs/COLA-Net

main
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code
This branch is 37 commits behind MC-E:main.

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
CAR
 
 
 
 
 
 
 
 
 
 

COLA-Net: Collaborative Attention Network for Image Restoration

This repository is for COLA-Net introduced in the following paper: Chong Mou, Jian Zhang, Xiaopeng Fan, Hangfan Liu, and Ronggang Wang, "COLA-Net: Collaborative Attention Network for Image Restoration", (IEEE Transactions on Multimedia 2021)

The code is built based on RNAN.

Contents

  1. Introduction
  2. Tasks
  3. Citation
  4. Acknowledgements

Introduction

In this paper we propose a model dubbed COLA-Net to exploit both local attention and non-local attention to restore image content in areas with complex textures and highly repetitive details, respectively. It is important to note that this combination is learnable and self-adaptive. To be concrete, for local attention operation, we apply local channel-wise attention on different scales to enlarge the size of receptive field of local operation, while for non-local attention operation, we develop a novel and robust patch-wise non-local attention model for constructing long-range dependence between image patches to restore every patch by aggregating useful information (self-similarity) from the whole image.

The pre-trained models are available at https://drive.google.com/file/d/1FVfQuGMV-AzOEFZILkBcgZuABHs9pyd_/view?usp=sharing.

Proposed COLA-Net

  1. The gloabal architecture of our proposed COLA-Net. Network
  2. The details of our proposed patch-based non-local attention method. Patch-based Non-local Method
  3. The visualization of the collaborative attention mechanism. Adaptive selection between local and non-local attention

Tasks

Gray-scale Image Denoising

PSNR_DN_Gray Visual_DN_Gray

Real Image Denoising

PSNR_DN_Gray Visual_DN_Gray

Image Compression Artifact Reduction

PSNR_DN_Gray Visual_DN_Gray

Citation

If you find the code helpful in your resarch or work, please cite the following papers.

@inproceedings{zhang2019rnan,
    title={Residual Non-local Attention Networks for Image Restoration},
    author={Zhang, Yulun and Li, Kunpeng and Li, Kai and Zhong, Bineng and Fu, Yun},
    booktitle={ICLR},
    year={2019}
}

@article{mou2021cola,
  title={COLA-Net: Collaborative Attention Network for Image Restoration},
  author={Chong, Mou and Jian, Zhang and Xiaopeng, Fan and Hangfan, Liu and Ronggang, Wang},
  journal={IEEE Transactions on Multimedia},
  year={2021}
}

Acknowledgements

This code is built on RNAN (PyTorch). We thank the authors for sharing their codes of RNAN.

About

COLA-Net: Collaborative Attention Network for Image Restoration, TMM2021 (PyTorch Code)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%