Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem caused by dataset changing #21

Closed
br-salima opened this issue May 9, 2020 · 6 comments
Closed

problem caused by dataset changing #21

br-salima opened this issue May 9, 2020 · 6 comments

Comments

@br-salima
Copy link

Hello good author,
First Thank you so much for your amazing code, can I get some help please
i tried changing the dataset with another one of 3D sterio images ( that contains right and left images ) and also tried fitting the data like what you did in your code and i made datainfo.mat file.
But i still get compatibily issues between the code and the data i prepared, probably caused by a missundestanding of something on my behalf.
That's why i wish for you to answer some questions that i have in mind please.
Why exactly did you choose 1000 senarios? Why not another nuber?
And also what is the role of the variables exp_id ? How does it help the code's progress?

thank you.

@lidq92
Copy link
Owner

lidq92 commented May 16, 2020

@salmora I'm not the author. I just implemented CNNIQA since the original author did not provide it.

for the 3D case, the inputs should be two images, you should change the network architectures so that it can accept your inputs and output the quality score.

You can refer the code in data_info_maker.m for data preparation, specifically, save the .mat file with -v7.3.

multiple (K) train-test splits are considered for avoiding content bias.
Larger K will be better and K has an upper bound, i.e., the number of different kinds of splits on the dataset.
In the paper, the author used K=100. And In my implementation, I generated K=1000 splits.
Each exp_id setting corresponds to an experiment under the exp_id%K-th split.

The code is very simple. Please read the whole repo and the paper, after that, I believe you can understand this method by yourself.

@br-salima
Copy link
Author

Thank you very much for taking the time to answer my question, I have another one please how did you compute subjective_scores_std in your file LIVEfallinfo.mat I tried to extract this information from the database but I did not find enough information .
Thank you.

@lidq92
Copy link
Owner

lidq92 commented May 16, 2020

@salmora Please refer to LIVE dataset.

"Download realigned subjective quality data here."

After deleting the corresponding values for reference images (i.e., orgs=1), dmos_new and dmos_std are the subjective_scores and subjective_scores_std.

You should also read the paper that describes the dataset.

@br-salima
Copy link
Author

in my database for 3D images I don't have the information about subjective_scores_std I have only subjective_scores please I wanna know if that will effect the result of the modele

@br-salima
Copy link
Author

thank you so much

@lidq92
Copy link
Owner

lidq92 commented May 17, 2020

@salmora If you read the whole repo, you will find that in this repo subjective_scores_std is only used for calculating the performance criterion outlier_ratio, i.e., OR (line 75 in main.py).

Suggestion:
Make sure you have read the whole repo, the full paper about the model CNNIQA, and the full paper about the datasets.

@lidq92 lidq92 closed this as completed May 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants