Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

metric depth estimation finetuned with nuscenes #172

Open
xiaobh1519 opened this issue May 13, 2024 · 3 comments
Open

metric depth estimation finetuned with nuscenes #172

xiaobh1519 opened this issue May 13, 2024 · 3 comments

Comments

@xiaobh1519
Copy link

Hi, thanks for your great work!
I have tried a lot of experiments to fintune your metric depth estimation model with nuscenes dataset. But I find that the results turns worse ( “corrugations” appear) after about 3K steps like images below. The situation becomes more intense as training steps increases.
image
image
image
And I found that the effect of this phenomenon varies for images with different input resolutions. Can you tell me why this phenomenon occurs?
I have been troubled by this issue for a long time. I would be extremely grateful if I could get your answer.

@XYQ0121
Copy link

XYQ0121 commented May 15, 2024

@xiaobh1519 Hello, I am also fine-tuning metric depth estimation using a custom dataset. I plan to use the KITTI config. My image size is 2160*3840. Can you tell me what modifications you made?Thanks a lot!
Snipaste_2024-05-15_10-12-04

@XYQ0121
Copy link

XYQ0121 commented May 15, 2024

Even though I changed the image size to 2160*3840 in the KITTI config, it does not match the printed values from the config. Is there any problem with this situation?
Snipaste_2024-05-15_10-58-15

@LiheYoung
Copy link
Owner

Hi @xiaobh1519, did you try to decrease the learning rate of our pre-trained encoder?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants