Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Low Kitti RMSE results #6

Closed
kesaroid opened this issue Apr 8, 2021 · 2 comments
Closed

Low Kitti RMSE results #6

kesaroid opened this issue Apr 8, 2021 · 2 comments

Comments

@kesaroid
Copy link

kesaroid commented Apr 8, 2021

Hi, I used your pre-trained model to obtain results for Kitti validation and the RMSE values are extremely high even after post-processing the depth results like you have done to visualize the images.
All the depth pixels are way higher than expected, plus I noticed an inverse relationship where the closer objects have a higher value than the farther ones.
I was hoping to get more insight from you on how to get the same RMSE values for Kitti as you have mentioned in your paper.

@ranftlr
Copy link
Contributor

ranftlr commented Apr 12, 2021

The released models are the general-purpose models that are affine invariant. They are arbitrarily scaled with respect to the true metric depth, so you can't directly evaluate RMSE on these models. They also predict inverse depth, not depth, which explains the inverse relationship that you observe.

The RMSE numbers in the the paper refer to models that have been finetuned on the respective datasets. I've just updated the code and uploaded the weights. You can download the weights for KITTI here:

https://github.com/intel-isl/DPT/releases/download/1_0/dpt_hybrid_kitti-cb926ef4.pt

Then run with

python run_monodepth.py -t dpt_hybrid_kitti --kitti_crop

@kesaroid
Copy link
Author

Thank you. This was very helpful. I was able to reduce it to an RMSE of 2.80
Perhaps you might know how to reduce it further?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants