Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about TransE HITS@10 on FB15K dataset #69

Closed
artiit opened this issue Apr 8, 2020 · 1 comment
Closed

Question about TransE HITS@10 on FB15K dataset #69

artiit opened this issue Apr 8, 2020 · 1 comment

Comments

@artiit
Copy link

artiit commented Apr 8, 2020

Hi, I found that your hit@10 result on transE is 0.8x, but in fact the original paper is 0.4x, I am puzzled about this.

@aksnzhy
Copy link
Contributor

aksnzhy commented Apr 8, 2020

Hi. The original paper only uses 50 for the latent dimension size (we use 400). You can see this paper https://arxiv.org/pdf/1903.12287.pdf (Table-2) to compare our results with pytorch-biggraph (using 400 dim_size) Actually if we set dim_size to 400, the HITS@10 result of the original paper implementation is 0.74. You can also see some other open-source tools' results: https://github.com/thunlp/KB2E In KB2E, using dim_size 100 the HITS@10 is 0.702.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants