Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The results in the paper? #9

Open
eecoder-dyf opened this issue Sep 4, 2023 · 5 comments
Open

The results in the paper? #9

eecoder-dyf opened this issue Sep 4, 2023 · 5 comments

Comments

@eecoder-dyf
Copy link

I ran test.sh on LSUN-B dataset and its corresponding generated images by ADM, with checkpoint lsun_adm.pth, the output in terminal is:

'lsun_adm:lsun_adm' model testing on...                                                                                                                                                                                                                                                   
lsun_adm:                                                                                                                                                                                                                                                                                 
ACC: 0.89900                                                                                                                                                                                                                                                                              
AP: 0.99890                                                                                                                                                                                                                                                                               
R_ACC: 0.79800                                                                                                                                                                                                                                                                            
F_ACC: 1.00000

Are your results of AP and ACC refer to F_ACC,not including the result of real dataset?

@Rapisurazurite
Copy link

I encountered the same issue and also conducted testing on the LSUN dataset in the test/lsun_bedroom/imagenet directory, specifically the 0_real and 1_adm subsets. Here are the results of my test:

lsun_bedroom/imagenet:
ACC: 0.81600
AP: 0.99248
R_ACC: 0.63200
F_ACC: 1.00000

However, I'm unsure about the distinction between test/lsun_bedroom/imagenet and test/lsun_bedroom/lsun_bedroom. Could the author please provide an explanation? Thank you.

@RichardSunnyMeng
Copy link

I run test.py on dire/test/lsun_bedroom/lsun_bedroom using lsun_adm.pth and get the results :

ACC: 1.00000
AP: 1.00000
R_ACC: 1.00000
F_ACC: 1.00000

If convert the images in the "adm" folder into JPG same as issue #11 , I get the results:

ACC: 0.50000
AP: 0.63497
R_ACC: 1.00000
F_ACC: 0.00000

@WWQ203
Copy link

WWQ203 commented Oct 9, 2023

@eecoder-dyf I run test.py on dire/test/lsun_bedroom/lsun_bedroom using lsun_adm.pth and get the same result as you do.But RichardSunnyMeng(commented on Sep 5) said he got ACC:1 AP:1.Do you know how to get the same result as RichardSunnyMeng did?

@RichardSunnyMeng
Copy link

@eecoder-dyf I run test.py on dire/test/lsun_bedroom/lsun_bedroom using lsun_adm.pth and get the same result as you do.But RichardSunnyMeng(commented on Sep 5) said he got ACC:1 AP:1.Do you know how to get the same result as RichardSunnyMeng did?

The only modification I made was runing the code on cpu because I encountered an error on cuda.

@daaiwoni
Copy link

I ran test.sh on LSUN-B dataset and its corresponding generated images by ADM, with checkpoint lsun_adm.pth, the output in terminal is:

'lsun_adm:lsun_adm' model testing on...                                                                                                                                                                                                                                                   
lsun_adm:                                                                                                                                                                                                                                                                                 
ACC: 0.89900                                                                                                                                                                                                                                                                              
AP: 0.99890                                                                                                                                                                                                                                                                               
R_ACC: 0.79800                                                                                                                                                                                                                                                                            
F_ACC: 1.00000

Are your results of AP and ACC refer to F_ACC,not including the result of real dataset?

I got the same result.
ACC: 0.89900
AP: 0.99890
R_ACC: 0.79800
F_ACC: 1.00000
I used "dire\test\lsun_bedroom\lsun_bedroom\adm" and "dire\test\lsun_bedroom\lsun_bedroom\real" as dataset , and the used model is "checkpoints/lsun_adm.pth".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants