Skip to content
master
Switch branches/tags
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 

LDFNet

This repository contains the implementation details of our paper: [arXiv:1809.09077]
"Incorporating Luminance, Depth and Color Information by a Fusion-based Networks for Semantic Segmentation"
by Shang-Wei Hung , Shao-Yuan Lo, Hsueh-Ming Hang

image

Dependencies

  • Python 3
  • Pytorch 0.4.1

Network Structure

LDFNet adopts two distinctive sub-networks in a parallel manner to process multiple information.
Also, LDFNet employs the luminance information to assist the processing of the depth information in the D&Y encoder.

image

Evaluation

LDFNet achieves a mIoU scores of 71.3 % on the Cityscapes dataset without any pretrained model.[Benchmarks]
For the resolution 512x1024 input, LDFNet can run at the speed of 18.4 and 27.7FPS on a singel Titan X and GTX 1080 Ti, respectively.

Implementation:

Flow the steps presented below:

  • Download "train" and "model" files.
  • Create your own global file and put "train" and "model" in it.
  • Set the global file path in the very bottom of "main.py" in "train" file.
  • Create "save" file in your global file, and the trained model and the validation results will be saved in the file you specify.

Citing LDFNet

If you feel our LDFNet is useful for your research, please consider citing our paper:

  • S.-W. Hung, S.-Y. Lo and H.-M. Hang, “Incorporating Luminance, Depth and Color Information by a Fusion-based Network for Semantic Segmentation,” in International Conference on Image Processing, 2019.

About

Network Description of LDFNet

Resources

Releases

No releases published

Packages

No packages published

Languages