-
Notifications
You must be signed in to change notification settings - Fork 35
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Problem about the score #3
Comments
Thanks for your interest in our work@KleinXin.
|
Thank you for your suggestions! |
Hi @KleinXin KleinXin, I will upload the zip file to Baidu Yun. It may need many hours. Please keep attention to our GitHub page in the following days. I agree with you that normalizating the predicted score to a certain range may help to well reflect the image quality, but it may result in a worse correlation coefficient. Best, |
Thank you very much! |
Hi KleinXin, |
Yes, I want to know the score of the same image evaluated by different models. So I use SPAQ and Baidu. It seems these two models have a very large difference. I donot think one model can surpass another such a large score if they are all state of the art models. So I think the only reason is that the data are different. |
Hi KleinXin, The zip file can be downloaded at https://pan.baidu.com/s/1JzwZxwSOpIqcc16cOliBVw (code: 8og5). I think it is reasonable. For the following reasons,
|
Thank you very much! |
I carefully read your paper again. I used BL_release.pt model to do the test of 9800 images. All scores I got are around 45, with min-35 and max-60. The score of the blurred image on the top is 45 and I divided it by 100 to normalize values to [0,1]. I donot think that image should got such a high score. In fact, the score of that image from Baidu is 0.0025 after normalizing to [0,1] by dividing 100. Then I normalize scores of all images by using min & max values. The formular is v_norm = (v-min)/(max-min) where v is the score I got from the inference of BL_release.py model. Anying wrong with this procedure? |
Hi KleinXin, I think the normalization operation is one of good attempts. Were the 9800 images sampled from the SPAQ database? |
No, all images are acquired from internet. |
The score of the image below is 0.38 when testing using model 'BL_release.pt'. I donot think it makes sense. Is there anything wrong with the model?
In fact, I tested 9800 images using this model and scores are all around 0.45 which seems strange.
The text was updated successfully, but these errors were encountered: