ReSFU

Codes for our paper "A Refreshed Similarity-based Upsampler for Direct High-Ratio Feature Upsampling".

Installation

First, install the 'FNS_Attn' module which requires CUDA compilation:

cd FNS_Attn/
python setup.py develop

(Optional) If you wish to use the mmsegmentation benchmark, install it by:

cd mmsegmentation/
pip install -e .

Usage

Demo

Please check our demo for the usage of ReSFU for non-hierarchical scenarios, e.g., Segmenter, and hierarchical scenarios, e.g., SegFormer.

MMSegmentation

To train the Segmenter-S model with ReSFU, run:

cd mmsegmentation/
sh tools/dist_train.sh configs/segmenter/segmenter_vit-s_fcn_8xb1-160k_ade20k-512x512_resfu.py 8 \
 --work-dir=work_dirs/segmenter_vit-s_fcn_8xb1-160k_ade20k-512x512_resfu

To train the SegFormer-B1 model with ReSFU, run:

cd mmsegmentation/
sh tools/dist_train.sh configs/segformer/segformer_mit-b1_8xb2-160k_ade20k-512x512_resfu.py 8 \
 --work-dir=work_dirs/segformer_mit-b1_8xb2-160k_ade20k-512x512_resfu