will you release any pretrained model?

[anxu829]

thank you for your open source code
will you release your pretrain model trained by this repo?

[uakarsh]

We are trying to think for releasing it, but we need to make sure that, our model is performing as closely as that mentioned in the paper

[philschmid]

any update here? It might be an nice addition to Hugging Face Transformers!

[uakarsh]

Hi @philschmid, I did try to train DocFormer from scratch on FUNSD dataset.

Here is the script, Kaggle Notebook, and here are the results Weight and Bias Report

When we see the results, the model is overfitting the train data and can obtain 100 percentage results on each of those metrics but around 30 percentage on the validation set (refer to the kaggle notebook's last section).

Not sure, about how to confirm if the implementation is appropriate or not.

Regards,
Akarsh