Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tools: Use 4 cores as default for parallelized tools #3901

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

wenzeslaus
Copy link
Member

@wenzeslaus wenzeslaus commented Jun 19, 2024

Given the common requests for parallelization by default and 4 cores (threads, processes) being most efficient, this is changing the default for nprocs for all tools to 4.

The value can be changed in GUI settings or using g.gisenv using the NPROCS variable.

This will require review of all test of tools with nprocs to make sure they are using nprocs=1 and not the default when parallelization is not tested. (This is in context of #3879.)

Given the common requests for parallelization by default and 4 cores (threads, processes) being most efficient, this is changing the default for nprocs for all tools to 4.

The value can be changed in GUI settings or using g.gisenv using the NPROCS variable.

This will require review of all test of tools with nprocs to make sure they are using nprocs=1 and not the default when parallelization is not tested.
@wenzeslaus wenzeslaus requested a review from ldesousa June 19, 2024 13:34
Copy link
Contributor

@ldesousa ldesousa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Even my cellphone has more than 4 cores. The only context in which this may be a nuisance is in HPC, where usually each process is assigned only one compute core. However, since the default behaviour is what newer users will have contact with I think this change is useful. In a HPC context more advanced users should be expected, aware of how tweak this setting.

@github-actions github-actions bot added C Related code is in C libraries labels Jun 19, 2024
@ecodiv
Copy link
Contributor

ecodiv commented Jun 20, 2024

Setting a mask will disable use of multiple processes if I understand well. Something easy to overlook as an end user.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C Related code is in C libraries
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants