Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question about 3-hop on full KG #15

Closed
xjtusedy opened this issue Aug 13, 2020 · 2 comments
Closed

question about 3-hop on full KG #15

xjtusedy opened this issue Aug 13, 2020 · 2 comments

Comments

@xjtusedy
Copy link

I have run the LSTM code for 3-hop on full KG settings, but I got a 0.7271963009667928 score. Do I need to change some parameters when I run the code for 3-hop?
Thanks!

@apoorvumang
Copy link
Collaborator

You are right, we get about ~0.75 with the best hyperparameters but without relation scoring. In 3-hop setting, since the paths are too long, relation scoring is needed to get good performance.

I will be adding the relation scoring soon, I apologize for the delay. Please keep track of the 'relation scoring' issue for this resolution.

@ToneLi
Copy link

ToneLi commented Sep 12, 2020

I have run the LSTM code for 3-hop on full KG settings, but I got a 0.7271963009667928 score. Do I need to change some parameters when I run the code for 3-hop?
Thanks!
Dear Sir or Madam, can you share your command in metaQA-hop3-full kg, my result in hop3 is 0.48, it's too low.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants