Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

F-score on CORD dataset #9

Open
taosong2019 opened this issue Apr 12, 2022 · 1 comment
Open

F-score on CORD dataset #9

taosong2019 opened this issue Apr 12, 2022 · 1 comment

Comments

@taosong2019
Copy link

Thanks for the excellent work! I am trying to reproduce the result on CORD dataset. However, I find the f-score results in your paper are somewhat different from that in LayoutLMv2 paper. Specifically, LayoutLMv2*-base achieves 96.05 and LayoutLMv2*-large achieves 97.24 in your paper. While in LayoutLMv2 paper, LayoutLMv2-base achieves 94.95 and LayoutLMv2-large achieves 96.01. Could you give an example of BROS fine-tuning on CORD dataset? Thanks!

@tghong
Copy link
Collaborator

tghong commented Apr 16, 2022

Thank you for your interest in our work!
The scores can be different because the fine-tuning script of LayoutLMv2* is our own implementation and the fine-tuning settings (e.g. batch size, # training steps) of LayoutLMv2 are unknown.
You can conduct fine-tuning experiments by preprocessing the CORD dataset similarly to the datasets in this repo.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants