Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem about real depth #10

Open
Kaede93 opened this issue Aug 31, 2020 · 10 comments
Open

problem about real depth #10

Kaede93 opened this issue Aug 31, 2020 · 10 comments

Comments

@Kaede93
Copy link

Kaede93 commented Aug 31, 2020

Hello, I am woundering that how can I get the depth images from real hazy images for training the Image translation module?

Because I noticed that training the S2R-R2S network cycle, we must input the depth images for synthetic hazy images and depth images for real hazy images.

I found that an unlabeled depth dataset is provided, but what if I want to train the network with my own dataset? It seems that there is no guidance for getting this "unlabeled depth", or did I missing something?

Thank you. BTW, 华科nb!

@Kaede93
Copy link
Author

Kaede93 commented Aug 31, 2020

Oh, I found a depth estimation paper you already quote:

[37] Chuanxia Zheng, Tat-Jen Cham, and Jianfei Cai. T2net:
Synthetic-to-realistic translation for solving single-image
depth estimation tasks. In European Conference on Computer
Vision, 2018. 3

Is that the method for getting the depth images from real hazy images in your paper?

@Four97
Copy link

Four97 commented Oct 8, 2020

have you gotten the real image's depth?
is ok to test the model with the pictures which dont have depth images?

@Kaede93
Copy link
Author

Kaede93 commented Oct 12, 2020

have you gotten the real image's depth?
is ok to test the model with the pictures which dont have depth images?

Hi, I sent an email to one of the authors Shao and he replied that they used the method in "MegaDepth: Learning Single-View Depth Prediction from Internet Photos"(2018 CVPR) for obtaining the depth images.

I haven't try yet because I'm struggled with other issues, please contact me if you done the jobs :)

@Four97
Copy link

Four97 commented Oct 12, 2020

have you gotten the real image's depth?
is ok to test the model with the pictures which dont have depth images?

Hi, I sent an email to one of the authors Shao and he replied that they used the method in "MegaDepth: Learning Single-View Depth Prediction from Internet Photos"(2018 CVPR) for obtaining the depth images.

I haven't try yet because I'm struggled with other issues, please contact me if you done the jobs :)

Thanks a lot. I will try it latter.

@rgbd-zml
Copy link

have you gotten the real image's depth?
is ok to test the model with the pictures which dont have depth images?

Hi, I sent an email to one of the authors Shao and he replied that they used the method in "MegaDepth: Learning Single-View Depth Prediction from Internet Photos"(2018 CVPR) for obtaining the depth images.

I haven't try yet because I'm struggled with other issues, please contact me if you done the jobs :)

Does the cycleGAN network need a depth map of a real picture or a depth map of a synthesized picture?

@Kaede93
Copy link
Author

Kaede93 commented Oct 28, 2020

have you gotten the real image's depth?
is ok to test the model with the pictures which dont have depth images?

Hi, I sent an email to one of the authors Shao and he replied that they used the method in "MegaDepth: Learning Single-View Depth Prediction from Internet Photos"(2018 CVPR) for obtaining the depth images.
I haven't try yet because I'm struggled with other issues, please contact me if you done the jobs :)

Does the cycleGAN network need a depth map of a real picture or a depth map of a synthesized picture?

Are we talking about the vanilla CycleGAN? The depth map was unnecessary for vanilla CycleGAN. In fact, it was doing the image to image domain transfer without any physical model, you can just transfer the hazy images to the clean ones.

@libertyllh
Copy link

have you gotten the real image's depth?
is ok to test the model with the pictures which dont have depth images?

Hi, I sent an email to one of the authors Shao and he replied that they used the method in "MegaDepth: Learning Single-View Depth Prediction from Internet Photos"(2018 CVPR) for obtaining the depth images.
I haven't try yet because I'm struggled with other issues, please contact me if you done the jobs :)

Does the cycleGAN network need a depth map of a real picture or a depth map of a synthesized picture?

Are we talking about the vanilla CycleGAN? The depth map was unnecessary for vanilla CycleGAN. In fact, it was doing the image to image domain transfer without any physical model, you can just transfer the hazy images to the clean ones.

In this paper, I did not see the requirements of real image depth map. What is its function? Is it necessary?

@Kaede93
Copy link
Author

Kaede93 commented Nov 14, 2020

have you gotten the real image's depth?
is ok to test the model with the pictures which dont have depth images?

Hi, I sent an email to one of the authors Shao and he replied that they used the method in "MegaDepth: Learning Single-View Depth Prediction from Internet Photos"(2018 CVPR) for obtaining the depth images.
I haven't try yet because I'm struggled with other issues, please contact me if you done the jobs :)

Does the cycleGAN network need a depth map of a real picture or a depth map of a synthesized picture?

Are we talking about the vanilla CycleGAN? The depth map was unnecessary for vanilla CycleGAN. In fact, it was doing the image to image domain transfer without any physical model, you can just transfer the hazy images to the clean ones.

In this paper, I did not see the requirements of real image depth map. What is its function? Is it necessary?

The equation (5) and (6) of this paper mentioned the real image depth map, which is used for training the translation network (for getting cycle consistency loss for S2R and R2S). The open source code also used the real image depth map. You can check this part for getting more information.

In fact, I don't precisely remember which part of this paper mentioned the real image depth map since my notes left behind in my laboratory (I will renew this comment on workday if necessary).

@wushunshun
Copy link

Hello, have you gotten the real image's depth?
is ok to test the model with the pictures which dont have depth images?

@Four97
Copy link

Four97 commented Jan 5, 2021 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants