segmentation

Semantic Segmentation

Support Models：

• FCN
• PSPNet
• DeepLabv3
• DANet
• BiseNet
• OCNet
• CCNet

Performance

Pascal VOC 2012

Here, we using train (10582), val (1449), test (1456) as most paper used. (More detail can reference DeepLabv3) . And the performance is evaluated with single scale

• Base Size 540, Crop Size 480

Model	backbone	Paper	OHEM	aux	dilated	JPU	Epoch	val (crop)	val
FCN	ResNet101-v1s	/	✗	✓	✗	✓	50	94.54/78.31	94.50/76.89
PSPNet	ResNet101-v1s	/	✗	✓	✓	✗	50	94.87/80.13	94.88/78.57
DeepLabv3	ResNet101-v1s	no / 77.02	✗	✓	✗	✓	50	95.17/81.00	94.81/78.75
DANet	ResNet101-v1s	/	✗	✗	✗	✓	50
BiSeNet	ResNet18-v1b	/	✗	✗	✗	✗	50	92.58/71.89	91.86/67.11
OCNet-Base	ResNet101-v1s	/	✗	✓	✗	✓	50	94.91/80.33	94.86/79.07
CCNet	ResNet101-v1s	/	✗	✓	✗	✓	50

1. the metric is pixAcc/mIoU

Cityscapes

• Base Size 1024, Crop Size 768

Model	backbone	Paper(*)	OHEM	aux	dilated	JPU	Epoch	val (crop)	val
FCN	ResNet101-v1s	no/75.96	✗	✓	✗	✓	120	96.29/73.60	96.18/78.61
PSPNet	ResNet101-v1s	no/78.56	✗	✓	✗	✓	120	96.21/73.64	96.09/78.62
DeepLabv3	ResNet101-v1s	no/78.90	✗	✓	✗	✓	120	96.25/73.44	96.23/79.03
DANet	ResNet101-v1s	no/78.83
OCNet-Base	ResNet101-v1s
BiSeNet	ResNet18-v1b

Note：

1. Paper(*) means results from: openseg.pytorch or original paper.（results with single scale without crop），there are a little different in the training strategy.

Demo

Demo of segmentation of a given image. (Please download pre-trained model to ~/.torch/models first. --- If you put pre-trained model to other folder, please change the --root)

$ python demo_segmentation_pil.py [--model deeplab_resnet101_ade] [--input-pic <image>.jpg] [--cuda true]

Note：if not give --input-pic, using default image we provided.

Evaluation

The default data root is ~/.torch/datasets (You can download dataset and build a soft-link to it)

$ python eval_segmentation_pil.py [--model_name fcn_resnet101_voc] [--dataset pascal_paper] [--split val] [--mode testval|val] [--base-size 540] [--crop-size 480] [--aux true] [--jpu true] [--dilated false] [--cuda true] 

Note：

1. if you choose mode=testval，you can not set base-size and crop-size
2. aux, jpu, dilated is depend on your model

Train

Download pre-trained backbone and put it on ~/.torch/models

Recommend to using distributed training.

$ export NGPUS=4
$ python -m torch.distributed.launch --nproc_per_node=$NGPUS train_segmentation_pil.py [--model fcn] [--backbone resnet101] [--dataset pascal_paper] [--batch-size 8] [--base-size 540] [--crop-size 480] [--aux true] [--jpu true] [--dilated false] [--log-step 10]

Our training results' setting can see seg.sh

Others

Backbone

resnet50_v1s	resnet101_v1s
Google Drive	Google Drive

TODO

• Improve performance, like using better pre-trained backbone (like torchvison or pretrained-models.pytorch)
• Add more Segmentation methods