Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How did the paper evaluate the TEDS? #12

Open
BlackDriver opened this issue Mar 4, 2022 · 1 comment
Open

How did the paper evaluate the TEDS? #12

BlackDriver opened this issue Mar 4, 2022 · 1 comment

Comments

@BlackDriver
Copy link

When I do my sub-category experiment in the sub-categories in WTW, because there may be more than one table in a single image, I tried to assemble the sub-cate result in your paper to find out the TEDS are calculated per image or per table, but both ways not matched the TEDS score of the whole test set.

我在做子类别实验的时候,因为一幅图里可能有几张表,所以我想知道你们论文的子类别实验到底是 TEDS/每图 还是 TEDS/每表,但是我用子类别TEDS指标加起来算总指标的时候,两种方式都对不上,所以我想知道你们是用什么规则计算TEDS的,或者干脆就是我算错了。。。

我是这样算的:
The formula below is my calculation method:
PER IMAGE:
from 'simple' to 'multicolor-grid'
result = (94.293 + 90.6670 + .... + 66.7*749) /3611 = 76.17

PER TABLE:
from 'simple' to 'multicolor-grid'
result = (94.293 + 90.6676 + .... + 66.7*991) /4048 = 75.6

These reults not match any score in your paper
What's wrong with that?Maybe I'm just stupid but please tell me the right method.

@cv-small-snails
Copy link

@wangwen-whu

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants