Skip to content
Deep Surface Normal Guided Depth Prediction for Outdoor Scene from Sparse LiDAR Data and Single Color Image
Branch: master
Clone or download
Latest commit 71632bd Jun 18, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
dataloader Add files via upload Apr 16, 2019
submodels Add files via upload Apr 7, 2019
surface_normal Add files via upload Apr 18, 2019
trainings Update train.py Jun 18, 2019
utils Add files via upload Apr 7, 2019
README.md Update README.md Jun 12, 2019
pipline.PNG Add files via upload Apr 17, 2019
preprocess.py Add files via upload Apr 7, 2019
test.py Update test.py Apr 7, 2019

README.md

DeepLiDAR

This repository contains the code (in PyTorch) for "DeepLiDAR: Deep Surface Normal Guided Depth Prediction for Outdoor Scene from Sparse LiDAR Data and Single Color Image" paper (CVPR 2019) by Jiaxiong Qiu, Zhaopeng Cui, Yinda Zhang, Xingdi Zhang, Shuaicheng Liu, Bing Zeng and Marc Pollefeys.

Introduction

In this work, we propose an end-to-end deep learning system to produce dense depth from sparse LiDAR data and a color image taken from outdoor on-road scenes leveraging surface normal as the intermediate representation. image

Requirements

Pretrained Model

※NOTE: The pretrained model were saved in '.tar'; however, you don't need to untar it. Use torch.load() to load it.

Download Link

Train

  1. Get the surface normal of Lidar dataset by run the code in the folder named 'surface_normal'.
  2. Use the training strategy in the folder named 'trainings'.

Evaluation

  1. Fill the names of the folders in 'test.py':
'gt_fold': the location of your groundtruth folder;
'left_fold': the location of your RGB image folder;
'lidar2_raw': the location of your Sparse(LiDAR) depth folder.
  1. Use the following command to evaluate the trained on your own data.
python test.py --loadmodel (your trained model)

Citation

If you use our code or method in your work, please cite the following:

@inproceedings{qiu2018deeplidar,
  title={DeepLiDAR: Deep Surface Normal Guided Depth Prediction for Outdoor Scene from Sparse LiDAR Data and Single Color Image},
  author={Qiu, Jiaxiong and Cui, Zhaopeng and Zhang, Yinda and Zhang, Xingdi and Liu, Shuaicheng and Zeng, Bing and Pollefeys, Marc},
  booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
  year={2019}
}

Please direct any questions to Jiaxiong Qiu at qiujiaxiong727@gmail.com

You can’t perform that action at this time.