Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hello, the author. Is it convenient to provide some suggestions about the program running configuration? We can't implement 60 batch_ Size locally on the computer, it may cost a lot in renting servers, and the results are uncertain. #5

Open
15922534139 opened this issue Jul 24, 2022 · 1 comment

Comments

@15922534139
Copy link

Hello, the author. Does your article about knowledge map need high configuration when it comes to knowledge map? For example, we can't fully use batch in the experimental configuration at present_ If the size is equal to 60, is there any other way for you to get through? If you rent a server for a long time, it is also a great expense and has uncertainty, so ask the author for help.

@wyu97
Copy link
Member

wyu97 commented Jul 24, 2022

Maybe you can try to reduce the batch size and use gradient accumulation instead. For example, set batch size as 15 and set --gradient_accumulate as 4.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants