Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to determine the number in front of the rule template in nlt files for a new dataset? #3

Closed
davidlvxin opened this issue May 14, 2019 · 2 comments

Comments

@davidlvxin
Copy link

From the paper, we can know the number in front of the rule template indicates how often a parameterized rule of the given structure will be instantiated. But I still don't know how to determine this number for a new dataset like FB15K-237. Could you give me some suggestions? Thank you!

@rockt
Copy link
Member

rockt commented May 14, 2019

I think the general rule of thumb is the more the better. The number of rule templates is a hyperparameter that we usually set to maximize GPU utilization (though this is also influenced by the batch size). I would recommend starting with a small number of rule templates and large batch size, and then gradually increasing the number of rule templates and decreasing the batch size so that everything still fits on the GPU.

@davidlvxin
Copy link
Author

OK, I know, Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants