Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About eval #41

Open
BruceYu-Bit opened this issue Oct 14, 2021 · 1 comment
Open

About eval #41

BruceYu-Bit opened this issue Oct 14, 2021 · 1 comment

Comments

@BruceYu-Bit
Copy link

想请问在评测代码里面,是否对真值进行了二值化,以及在运行评测标准时,会计算人类的标准,大概score是0.8,这个是如何计算的?还有个问题是bsds500上面的原数据是由七个人标注,然后融合取平均,那在测试集上也是拿平均后的真值去评测的吗?

@xwjabc
Copy link
Owner

xwjabc commented Oct 14, 2021

Hi, thank you for your question. You may refer to this part of the code:

  Z=zeros(size(E)); matchE=Z; matchG=Z; allG=Z;
  for g = 1:n
    [matchE1,matchG1] = correspondPixels(E1,G{g},maxDist);
    matchE = matchE | matchE1>0;
    matchG = matchG + double(matchG1>0);
    allG = allG + G{g};
  end

In this snippet, n=5 (5 ground-truth maps for the same image) and G{g} refers to one ground-truth map. The evaluation procedure will accumulate the matching result for each G{g}. Hope it helps!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants