Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

high resource usage when parallelizing #2

Open
jjuod opened this issue May 27, 2018 · 2 comments
Open

high resource usage when parallelizing #2

jjuod opened this issue May 27, 2018 · 2 comments
Labels
enhancement New feature or request

Comments

@jjuod
Copy link
Collaborator

jjuod commented May 27, 2018

Parallel version seems to eat lots of RAM, at least at higher resolutions. For now, default setting changed to para=FALSE and parallelization is to be used at user's own risk. Would be good to add some max input size/resolution recommendations for parallel mode.

@jjuod jjuod added the enhancement New feature or request label May 27, 2018
@william-denault
Copy link
Owner

Agreed I will check that, and may be that could be done by the user. Or we could propose mutilple paralelmisation, i.e apply parApply or normal

@jjuod
Copy link
Collaborator Author

jjuod commented Jun 2, 2018

In addition: some systems appear to have linear algebra libraries which already implement parallelization. This means that many CPUs are reserved, but the calculations are relatively short and the overhead is not worth it. Recommend RhpcBLASctl, to limit BLAS threads to 1 or 2, as in commit 8124d2c

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants