Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The test results are obviously too small #58

Open
clttyou opened this issue May 16, 2022 · 4 comments
Open

The test results are obviously too small #58

clttyou opened this issue May 16, 2022 · 4 comments

Comments

@clttyou
Copy link

clttyou commented May 16, 2022

Hello, I am very interested in your work. I refer to the code in your project, first read the picture and label from LMDB format, and then convert the read picture and label to LMDB format. But I test with my own converted LMDB file, (I use /test/medium). Found out that data.mdb is 2x bigger than the data you provided. At the same time, the test accuracy is significantly reduced. Therefore, I suspect that there is something wrong with my conversion process, and I hope to get your help.
Medium data and test results provided by you:
data.mdb 5624KB
{'accuracy': {'medium': 0.2998}, 'psnr_avg': 19.378832, 'ssim_avg': 0.624525, 'fps': 28.96241389504168}
I transformed the data and test results myself
data.mdb 15324KB
{'accuracy': {'medium': 0.0014}, 'psnr_avg': 19.014374, 'ssim_avg': 0.625526, 'fps': 29.325254743748406}

您好,我对您的工作很感兴趣。我参考了您项目中的代码,先从LMDB格式读取图片和label,再将读取到的图片和label转换为LMDB格式。但是我用自己转换后的LMDB文件进行测试,(我使用的是/test/medium)。发现data.mdb比您提供的数据大2倍。同时测试精度明显降低。因此我怀疑自己的转换过程有问题,希望得到您的办帮助。
您提供的medium数据和测试结果:
data.mdb 5624KB
{'accuracy': {'medium': 0.2998}, 'psnr_avg': 19.378832, 'ssim_avg': 0.624525, 'fps': 28.96241389504168}
我自己转换数据和测试结果
data.mdb 15324KB
{'accuracy': {'medium': 0.0014}, 'psnr_avg': 19.014374, 'ssim_avg': 0.625526, 'fps': 29.325254743748406}

@JingyeChen
Copy link

Obviously there may be something wrong with your code ... Maybe you could use the provided lmdb file for testing :D The accuracy seems okay if using the provided lmdb.

@fuxjau
Copy link

fuxjau commented Jun 5, 2022

请问您知道论文中的平均准确率是如何计算的吗,我看了文章文章并为提及,也不是通过简单的对easy medium hard 准确率进行平均

@WenjiaWang0312
Copy link
Owner

WenjiaWang0312 commented Jun 6, 2022 via email

@E-qin
Copy link

E-qin commented Jun 14, 2022

@clttyou 您好,我同样遇到了这个问题,我测试的数据是medium,结果也类似,请问您现在解决了吗?

Hello, I am very interested in your work. I refer to the code in your project, first read the picture and label from LMDB format, and then convert the read picture and label to LMDB format. But I test with my own converted LMDB file, (I use /test/medium). Found out that data.mdb is 2x bigger than the data you provided. At the same time, the test accuracy is significantly reduced. Therefore, I suspect that there is something wrong with my conversion process, and I hope to get your help. Medium data and test results provided by you: data.mdb 5624KB {'accuracy': {'medium': 0.2998}, 'psnr_avg': 19.378832, 'ssim_avg': 0.624525, 'fps': 28.96241389504168} I transformed the data and test results myself data.mdb 15324KB {'accuracy': {'medium': 0.0014}, 'psnr_avg': 19.014374, 'ssim_avg': 0.625526, 'fps': 29.325254743748406}

您好,我对您的工作很感兴趣。我参考了您项目中的代码,先从LMDB格式读取图片和label,再将读取到的图片和label转换为LMDB格式。但是我用自己转换后的LMDB文件进行测试,(我使用的是/test/medium)。发现data.mdb比您提供的数据大2倍。同时测试精度明显降低。因此我怀疑自己的转换过程有问题,希望得到您的办帮助。 您提供的medium数据和测试结果: data.mdb 5624KB {'accuracy': {'medium': 0.2998}, 'psnr_avg': 19.378832, 'ssim_avg': 0.624525, 'fps': 28.96241389504168} 我自己转换数据和测试结果 data.mdb 15324KB {'accuracy': {'medium': 0.0014}, 'psnr_avg': 19.014374, 'ssim_avg': 0.625526, 'fps': 29.325254743748406}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants