Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The networks used for training model #6

Closed
Hazeline2018 opened this issue May 26, 2022 · 3 comments
Closed

The networks used for training model #6

Hazeline2018 opened this issue May 26, 2022 · 3 comments

Comments

@Hazeline2018
Copy link

Hello, thanks for the excellent work and sharing source codes. I'm working on mono-depth estimation for my robotic project and came across your work online. I saw two papers related to this git repo. one is and second one is .
I just quickly skimped through these two papers (not knowing too much details yet), and noticed that these two papers seem using different networks for training models.
The 1st paper uses YOLOv5 for both training networks (object detection & depth estimation); while the 2nd paper uses ResNet-50 for object detection and ResNet-18 for depth estimation. Are I correct?
My question is what exactly networks are being used in this git repo?
Thanks
Terry

@ArminMasoumian
Copy link
Owner

Thank you for showing your interest in this paper.
There are two papers:

GCNDepth: Self-supervised Monocular Depth Estimation based on Graph Convolutional Network

This paper is about a depth prediction and has two sub-network: DepthNet and PoseNet. The pre-trained model of ResNet50 is used for DepthNet and the Pre-trained model ResNet18 is used for PoseNet.
This repository is for this paper and you will get the relative distance of the objects with this model.

[Absolute distance prediction based on deep learning object detection and monocular depth estimation models]

This is the second paper. In this paper, we estimated the absolute distance of each object. This model has two sub-network as well. The first network is GCNDepth (the whole model of the first paper, which is this repo) and the second subnetwork is famous YOLOv5 for object detection. You can find the YOLOv5 code in the below link:

https://github.com/ultralytics/yolov5

@Hazeline2018
Copy link
Author

Thanks Armin, for the detailed explanation. I'm more interested in getting the absolute distance estimation since I have my own relative depth estimation model. I'm thinking to expand your 2nd paper work to combine a different relative depth estimation model with YOLOv5 model for absolute depth prediction following your proposed method. Would you think that will work? Thanks!

@ArminMasoumian
Copy link
Owner

Thanks Armin, for the detailed explanation. I'm more interested in getting the absolute distance estimation since I have my own relative depth estimation model. I'm thinking to expand your 2nd paper work to combine a different relative depth estimation model with YOLOv5 model for absolute depth prediction following your proposed method. Would you think that will work? Thanks!

Sure, you can do that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants