Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Thank you for your sharing! Is there any metrics code? #3

Closed
yiqingHuang0326 opened this issue Aug 10, 2021 · 3 comments
Closed

Thank you for your sharing! Is there any metrics code? #3

yiqingHuang0326 opened this issue Aug 10, 2021 · 3 comments

Comments

@yiqingHuang0326
Copy link

I am trying to reproduce the value of FID and KID of your program. Is there any metrics code for this program?
I only get the related information from the sentence "crop the central area of size 256 ×512 from the output panorama of size 256 ×768 for performing evaluation and comparison" in your paper, and want to know which pictures to be compared with the test results as well as how to crop the compared pictures.

@julia0607
Copy link
Owner

julia0607 commented Aug 10, 2021

For FID I'm using the implementation provided here, and for KID I'm using this implementation.
Basically for both FID and KID, the generated images are compared with random real images, so you can randomly select real images with same size and amount as your generated images.
For the evaluation provided in our paper, I'm using these real images, which are 2649 images with size 256 x 512 cropped from our testing set .

@yiqingHuang0326
Copy link
Author

Thanks a lot for your reply!
I am also confused that the amount of pictures in the test folder of the dataset named scenery6000_split only have 1000 images, is the 2649 pictures in the testing set are all cropped from it and how did you crop them?

@julia0607
Copy link
Owner

julia0607 commented Aug 10, 2021

Yes, all 2649 pictures are cropped from the 1000 testing images.
I randomly cropped multiple patches (each with size 256 x 512) from each testing images that is larger than 256 x 512, and therefore obtaining 2649 patches from those 1000 testing images.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants