Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend execute_entity_task capabilities #1297

Merged
merged 2 commits into from Sep 27, 2021
Merged

Conversation

TimoRoth
Copy link
Member

This adds the ability to pass a list of tasks to execute_entity_task, which will then execute all tasks in that list in sequence on each gdir, potentially more efficiently distributing the work, avoiding CPU downtime.

Also documents some abilities the function had for a long time about per-gdir kwargs.

@pep8speaks
Copy link

pep8speaks commented Sep 22, 2021

Hello @TimoRoth! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

There are currently no PEP 8 issues detected in this Pull Request. Cheers! 🍻

Comment last updated at 2021-09-22 18:40:59 UTC

@TimoRoth TimoRoth force-pushed the new_task_logic branch 6 times, most recently from e5f6393 to a85f256 Compare September 22, 2021 18:26
@TimoRoth
Copy link
Member Author

Some performance comparisons:

Old method:
slurm-9698.out:real 18m34.619s
slurm-9753.out:real 18m56.377s
slurm-9754.out:real 18m23.709s
slurm-9755.out:real 18m35.420s
slurm-9756.out:real 18m51.713s
slurm-9757.out:real 18m26.689s

New method:
slurm-9699.out:real 18m18.392s
slurm-9759.out:real 18m13.198s
slurm-9760.out:real 18m17.620s
slurm-9761.out:real 18m35.503s
slurm-9762.out:real 18m17.189s
slurm-9763.out:real 18m26.404s

So there is a small performance benefit for my cobbled together test case. And more importantly: Not a performance regression.

@fmaussion fmaussion merged commit b378587 into OGGM:master Sep 27, 2021
@fmaussion
Copy link
Member

Cheers! I'll try to think of this when updating the notebooks in future OGGM versions

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants