Skip to content
A Tensorflow interface for the paper: Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture (***Deprecated***)
Branch: master
Clone or download
Latest commit be4fe3a Jan 23, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
README.md
depth_net_utils.py Added files for net Sep 18, 2016
img_0004_abs_smooth_new.png Add files via upload Dec 20, 2017
img_0331_abs_smooth_new.png Add files via upload Dec 20, 2017
img_0807_abs_smooth_new.png
img_0815_abs_smooth_new.png
model.py

README.md

Deprecated

Please note that this repository is longer functional and only exists for archival purposes. Since the release of this repository, several other approaches (e.g. https://arxiv.org/abs/1609.03677) have produced superior results; therefore, I recommend that you explore these methods instead. Regardless, the model.py provides a "barebones" implementation without weights or display tools.

DepthNet

DepthNet is an unofficial Tensorflow implementation of Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture. Note: This repository was created for a research project, not associated with NYU, to explore the implications of residual neural networks for monocular depth estimation and smartphone-based spatial mapping. These modifications were not included in this repository for compeleteness. If you would like these modification, please email me at rcbridendev@gmail.com.

Installation

There are two ways to install NYUDepthNet - Automatic and Manual. The latter is complex to configure, so it's recommended that you use the Automatic method.

Automatic

This is the recommended way to install NYUDepthNet.

  • Clone the repository.
  • Install dependencies
  • Run main.py to ensure NYUDepthNet was installed correctly.

Manual

This installation method is more complex; however, it does grant increased customizability.

  • Clone the repository.
  • Install dependencies
    • Theano
    • Install the dependencies mentioned in the Automatic method.
  • There are two methods to setup the installation:
    1. Run setup_env.py
    2. Manually download an unpack weights
      • Download weights and scripts from NYU
      • Convert weights from .pk format to .npy or to tensorflow variables. NOTE: These weights are formatted as Theano tensors, so they must be converted to Tensorflow tensors. See TheanoUnpickler.
  • Run main.py to ensure NYUDepthNet was installed correctly.

Example Images

alt text alt text alt text alt text

You can’t perform that action at this time.