Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FID not matching for COCO dataset #19

Open
Mishra1995 opened this issue Sep 5, 2022 · 1 comment
Open

FID not matching for COCO dataset #19

Mishra1995 opened this issue Sep 5, 2022 · 1 comment

Comments

@Mishra1995
Copy link

Mishra1995 commented Sep 5, 2022

Hi,

Thanks for providing the code for the paper!

I tried to reproduce the FID score on the COCO dataset by generating images for the validation dataset as reported in the paper using the generator for 120th epoch (netG_120.pth) and text encoder for 595th epoch. I used the Pytorch implementation of the FID score and it gives me around 121 FID score as opposed to 19 reported.

I had resized the original COCO images to 256x256 resolution to have a consistent image size but the score is still high.

Even the generation is weird for sample sentences.

For eg.

The image attached has caption "A close up of a boat on a field with a cloudy sky". This caption has been taken from the paper but the generation using the final generator model and text encoder model is nowhere near presented in the paper.

Any suggestions from your side as to what has to be done?
img_0

Also can you please mention the difference between main.py and main_finetune.py? There is not much of a difference in both these scripts.

@QinSY123
Copy link

I have tested the valid dataset on COCO2014, and the FID score is 18.18. However, the visualization results are not ideal.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants