Deep Reflectance Codes (DRC): A Hashing Approach for Material Retrieval
Matlab C++ Other
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
Kronecker_Projection @ 1bea69a kronecker added Mar 18, 2016
baseline Added files via upload Mar 18, 2016
matconvnet @ 3a9bf9c
matlab-helpers
misc_lib Added files via upload Mar 18, 2016
vlfeat @ f363f3a added module Mar 18, 2016
.gitignore
.gitmodules module May 8, 2016
HashForFriction_Demo.m
LatexTable.m Added files via upload Mar 18, 2016
README.md Update README.md Oct 27, 2016
compute_confusion.m Added files via upload Mar 18, 2016
distinguishable_colors.m Added files via upload Mar 18, 2016
drawFigure2016.m fix bugs May 8, 2016
dtd_get_database.m Added files via upload Mar 18, 2016
encoder_save.m
fmd_get_database.m
getResult.m Added files via upload Mar 18, 2016
get_dcnn_features.m fix bugs May 8, 2016
get_rcnn_features.m
kth_get_database.m Added files via upload Mar 18, 2016
kthtips_get_database.m Added files via upload Mar 18, 2016
normalization.m
os_attr_get_database.m Added files via upload Mar 18, 2016
os_get_gt_regions.m Added files via upload Mar 18, 2016
os_seg_test.m
os_setup.m
os_train.m
print_dataset_info.m Added files via upload Mar 18, 2016
reflectance_get_database.m fix bugs May 8, 2016
runExperiments.m update May 9, 2016
savefast.m Added files via upload Mar 18, 2016
setup.m setup Apr 10, 2016
test_all_methods.m Added files via upload Mar 18, 2016

README.md

Deep Reflectance Codes (DRC), A Hashing Approach for Material Retrieval

Created by Hang Zhang, Kristin Dana and Ko Nishino

Introduction

This repository contains the code for reproducing the results in the paper (ECCV 2016):

  @inproceedings{zhang2016friction,
     Author = {Hang Zhang and Kristin Dana and Ko Nishino},
     Title = {Friction from Reflectance: Deep Reflectance Codes for Predicting Physical Surface Properties from One-Shot In-Field Reflectance},
     Booktitle = {Proceedings of the European Conference on Computer Vision ({ECCV})},
     Year = {2016}
  }

If you use the code for your research, please cite our paper. Link to the project

Get Started

  • The code relies on vlfeat, and matconvnet, which should be downloaded and built before running the experiments. (Supprting the version matconvnet-1.0-beta18.) You can use the following commend to download them:

      git clone --recurse-submodules https://github.com/zhanghang1989/Deep-Reflectance-Code.git
    
  • Download the model VGG-M to data/models (older models can also be updated using the vl_simplenn_tidy function).

  • Download the following dataset to data/

    • Reflectance Disks (reflectance)
    • Flickr Material Database (fmd)
    • Describable Textures Dataset (dtd)
    • Textures under varying Illumination (kth)
  • run_Experiments.m reproducing general material recogniton results

  • HashForFriction_Demo.m reproducting friction prediction results

General Material Recogniton Results

Dataset FV-SIFT-Hash CNN-ITQ VLAD-CNN-KBE FV-CNN-KBE DRC DRC-opt
reflectance 64.5% 51.9% 60.1% 58.8% 59.9% 60.2%
FMD 48.3% 65.0% 59.4% 57.7% 64.8% 65.5%
DTD 43.6% 52.6% 52.3% 53.1% 55.4% 55.8%
KTH 72.0% 73.7% 75.6% 54.4% 76.6% 77.2%

Acknowldgements

This work was supported by National Science Foundation award IIS-1421134 to KD and KN and Office of Naval Research grant N00014-16-1-2158 (N00014-14-1-0316) to KN.

We thank vlfeat and matconvnet teams for creating and maintaining these excellent packages. We would like to thank Felix Yu for hashing algorithms and Cimpoi for FV-CNN encoders. The copyrights of original code reserve.