Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reproducing the results on the paper #32

Closed
seyeeet opened this issue Aug 27, 2021 · 1 comment
Closed

reproducing the results on the paper #32

seyeeet opened this issue Aug 27, 2021 · 1 comment

Comments

@seyeeet
Copy link

seyeeet commented Aug 27, 2021

Thanks for sharing the code,
can you please share arguments that has been used for training, specifically in the paper propose a modified version of positional encoding but I see that it is set to use None in the file.
Thanks for your help.

@yhcc
Copy link
Member

yhcc commented Sep 17, 2021

pos_embed=None means the model does not use the absolute position embedding (The model is set to use the relative position embedding.). Hyper-parameters are provided in the training file for each dataset.

@seyeeet seyeeet closed this as completed Sep 17, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants