Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
shurans committed Jan 11, 2017
1 parent 5273bab commit 5f1650b
Show file tree
Hide file tree
Showing 2 changed files with 39 additions and 35 deletions.
72 changes: 38 additions & 34 deletions README.md
@@ -1,44 +1,48 @@
* Compile code
1. Download CUDA 7.5 and cuDNN 3. You will need to register with NVIDIA.
2. cd code/marvin
3. ./linux.sh
# Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Images
## Compile code
Download CUDA 7.5 and cuDNN 3. You will need to register with NVIDIA.
```shell
cd code/marvin
./linux.sh
```
## Prepare data
* download the processed RGBD data [here](http://dss.cs.princeton.edu/Release/sunrgbd_dss_data) by runing script:
```shell
downloadData('../sunrgbd_dss_data','http://dss.cs.princeton.edu/Release/sunrgbd_dss_data/','.bin');
```
* or run dss_preparedata() to prepare your own data.

* Prepare data
download the processed RGBD data :
http://dss.cs.princeton.edu/Release/sunrgbd_dss_data
by runing script:
downloadData('../sunrgbd_dss_data','http://dss.cs.princeton.edu/Release/sunrgbd_dss_data/','.bin');
or run dss_preparedata() to prepare your own data.

download the image and hha images:
http://dss.cs.princeton.edu/Release/hha
http://dss.cs.princeton.edu/Release/image
by runing script:
downloadData('../image','http://dss.cs.princeton.edu/Release/image/','.tensor');
* download the image and hha images by runing script:
downloadData('../image','http://dss.cs.princeton.edu/Release/image/','.tensor');
downloadData('../hha','http://dss.cs.princeton.edu/Release/hha/','.tensor');

### 3D region proposal network:
* You can download the precomputed region proposal for NYU and SUNRGBD dataset from:
http://dss.cs.princeton.edu/Release/result/proposal/RPN_SUNRGBD/
http://dss.cs.princeton.edu/Release/result/proposal/RPN_NYU/

* 3D region proposal network:
1. You can download the precomputed region proposal for NYU and SUNRGBD dataset from:
http://dss.cs.princeton.edu/Release/result/proposal/RPN_SUNRGBD/
http://dss.cs.princeton.edu/Release/result/proposal/RPN_NYU/
by runing script:
downloadData('../proposal','http://dss.cs.princeton.edu/Release/result/proposal/RPN_NYU/','.mat');
by runing script:
```shell
downloadData('../proposal','http://dss.cs.princeton.edu/Release/result/proposal/RPN_NYU/','.mat');
```

2. To train 3D region proposal network and extract 3D region proposal
* To train 3D region proposal network and extract 3D region proposal
cd code/matlab_code/slidingAnchor
run dss_prepareAnchorbox() to prepare training data.
run RPN_extract() to extract 3D region proposal.
You may need the segmentation result here:
downloadData('../seg','http://dss.cs.princeton.edu/Release/seg/','.mat');
```shell
downloadData('../seg','http://dss.cs.princeton.edu/Release/seg/','.mat');
```
* Pretrained model and network defination can be found [here](http://dss.cs.princeton.edu/Release/pretrainedModels/DSS/RPN/multi_dpcv1/)


* 3D object detection network:
1. change path in dss_initPath.m;
2. run dss_marvin_script(0,100,1,[] ,1,'RPN_NYU',1,[],0,0);
Pretrained model:
http://dss.cs.princeton.edu/Release/pretrainedModels/DSS/ORN/DSSnet_ORN_d.marvin
## 3D object detection network:
1. change path in dss_initPath.m;
2. run dss_marvin_script(0,100,1,[] ,1,'RPN_NYU',1,[],0,0);
3. Pretrained model and network defination can be found [here](http://dss.cs.princeton.edu/Release/pretrainedModels/DSS/ORN/)

Notes :
1. If matlab system call fails, you can try to run the command directly.
2. The rotation matrixes for some of the images in the dataset are different from the original SUNRGB-D dataset, so that the rotation only contains camera tilt angle (i.e. point cloud does not rotated on the x,y plane). We provide the data in this repo "./external/SUNRGBDtoolbox/Metadata/SUNRGBDMeta.mat"
All the results and ground truth boxes provided in this repo are using this rotation matrix.
To convert the rotation matrix you can reference the code "changeRoomR.m"
### Notes :
* If matlab system call fails, you can try to run the command directly.
* The rotation matrixes for some of the images in the dataset are different from the original SUNRGB-D dataset, so that the rotation only contains camera tilt angle (i.e. point cloud does not rotated on the x,y plane). We provide the data in this repo ```./external/SUNRGBDtoolbox/Metadata/SUNRGBDMeta.mat```. All the results and ground truth boxes provided in this repo are using this rotation matrix. To convert the rotation matrix you can reference the code "changeRoomR.m"

2 changes: 1 addition & 1 deletion matlab_code/slidingAnchor/RPN_get2DBoxes.m
@@ -1,5 +1,5 @@
NYUonly = 1;
load('/n/fs/modelnet/SUN3DV2/prepareGT/Metadata/SUNRGBDMeta_tight_Yaw.mat');
load('/n/fs/modelnet/SUN3DV2/prepareGT/Metadata/SUNRGBDMeta.mat');

proposal_dir = '/n/fs/modelnet/deepDetect/proposal/RPN_multi_dpcv10.35top150_5000/';
proposal_dir_tosave = '/n/fs/modelnet/deepDetect/proposal/RPN_multi_dpcv10.35top150_5000/';
Expand Down

0 comments on commit 5f1650b

Please sign in to comment.