Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

大规模KG的训练 #9

Closed
AprLie opened this issue Aug 10, 2022 · 3 comments
Closed

大规模KG的训练 #9

AprLie opened this issue Aug 10, 2022 · 3 comments

Comments

@AprLie
Copy link

AprLie commented Aug 10, 2022

Hi，

请问NeuralKG是否支持大规模KG的训练，如ogb的wikikg90m数据集？
@wencolani
Copy link
Contributor

你好，NeuralKG中的KGE模型都是可以用于大规模数据集如ogb的训练的，但需要硬件资源满足需求。

@AprLie
Copy link
Author

AprLie commented Aug 22, 2022

我测试时候发现NeuralKG不支持多卡训练，在加载数据时也直接就被Kill（硬件资源充足的情况）

@Modberge
Copy link
Collaborator

我测试时候发现NeuralKG不支持多卡训练，在加载数据时也直接就被Kill（硬件资源充足的情况）

您好，NeuralKG是基于Pytorch_lightning构建的KGE训练框架，您可以参考Pytorch_lightning官方的多卡训练教程来自定义trainer函数进行多卡训练。

@RuizhouLiu RuizhouLiu mentioned this issue Dec 10, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@wencolani @AprLie @Modberge