Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting different test results on the KITTI #9

Closed
guogangok opened this issue Feb 1, 2022 · 2 comments
Closed

Getting different test results on the KITTI #9

guogangok opened this issue Feb 1, 2022 · 2 comments

Comments

@guogangok
Copy link

guogangok commented Feb 1, 2022

  1. I downloaded your pre-trained model named "model18_lr" from: https://drive.google.com/file/d/1Z60MI_UdTHfoSFSFwLI39yfe8njEN6Kp/view?usp=sharing .

  2. I saved the estimated disparity map by your script:

python main.py
--val --data_path --resume /model18_192x640.pth.tar
--use_full_scale --post_process --output_scale 0 --disps_path

  1. I tested the depth map using the script provided by monodepth2
    ( https://github.com/nianticlabs/monodepth2/blob/master/evaluate_depth.py ).
    The command is: python evaluate_depth.py --data_path <dataset_dir> --eval_mono --ext_disp_to_eval <saved_depth_map> --post_process.

The result is:
Mono evaluation - using median scaling
Scaling ratios | med: 6.675 | std: 0.085

abs_rel | sq_rel | rmse | rmse_log | a1 | a2 | a3 |
& 0.169 & 0.981 & 5.269 & 0.241 & 0.745 & 0.943 & 0.978 \

It is not good. Is there anything I have missed?
Thank you!

@prstrive
Copy link
Owner

prstrive commented Feb 2, 2022

Our model is stereo. If you use monodepth2's script, you should probably use eval_stereo instead of eval_mono.

@prstrive prstrive closed this as completed Feb 3, 2022
@guogangok
Copy link
Author

guogangok commented Feb 3, 2022

We tested model18.pth.tar, the result seems OK. Perhaps there is something wrong with the model model18_192x640.pth.tar.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants