Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

the cross dataset test problem #1

Closed
Z9RO opened this issue Jan 14, 2019 · 4 comments
Closed

the cross dataset test problem #1

Z9RO opened this issue Jan 14, 2019 · 4 comments

Comments

@Z9RO
Copy link

Z9RO commented Jan 14, 2019

Hello!
I think the method proposed in this article is very novel.
I want to train the model on the LIVE dataset and test on TID2013. However,they have different label.(dmos for LIVE,mos for TID2013) I am not very familiar with matlab, so can you tell me how to convert these labels

@zwx8981
Copy link
Owner

zwx8981 commented Jan 15, 2019

@Z9RO Hi, actually you can directly train the model using original labels. For your example, LIVE uses DMOS (higher means worse quality) while TID2013 uses MOS (higher means better quality), you can simply train on LIVE with DMOS. When you test on TID2013, you can simply compute the absolute value of SRCC and PLCC as the final results.

@Z9RO
Copy link
Author

Z9RO commented Jan 15, 2019

Thanks, but I found the range of those datasets' value is different, LIVE is about [0,100], and TID2013 is about [0,10]. Do you have the exact range of those datasets? (I search the Internet and still don't find LIVEMD's and LIVEChallenge's)

@zwx8981
Copy link
Owner

zwx8981 commented Jan 15, 2019

@Z9RO I normalize subjective quality scores in all datasets into the same range for convenience. The range of both LIVEMD and LIVEChallenge are [0,100]

@Z9RO
Copy link
Author

Z9RO commented Jan 15, 2019

Thanks, it's very useful to me

@Z9RO Z9RO closed this as completed Jan 15, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants