Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CPU and GPU usage #8

Closed
sanketgujar opened this issue Jun 13, 2019 · 2 comments
Closed

CPU and GPU usage #8

sanketgujar opened this issue Jun 13, 2019 · 2 comments

Comments

@sanketgujar
Copy link

I am using one GPU to train the model, but it is still using around 10-16G CPU memory. Would you please tell what operations are using so much memory on the CPU.

@philip-huang
Copy link
Owner

Hmm interesting, I have never noticed this before. My guess would be the input preprocessing stuff is using too many threads/memory. This part is handled by the CPU because GPU training is not really the bottleneck (data preprocessing is).

My suggestion would be to take a look at the input preprocessing stuff and see if you can come up with a better way for your specific application.

@sanketgujar
Copy link
Author

Thanks for the reply, I did and the preprocessing was the issue. Closing the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants