Fix download of EEZ to happen on local (login) node #141
Conversation
Fixes an issue introduced in calliope-project#99.
|
Yes, this fails in my setup as compute nodes have no internet access. I believe you said once it's possible to change that, but I'd rather not if not necessary. It's true that downloads on compute nodes could be faster as they could be parallelised. But you can also parallelise downloads on the login node using In any case, all download rules right now are local. So we should be consistent either way. |
| @@ -14,6 +14,7 @@ SCHEMA_UNITS = { | |||
|
|
|||
| configfile: "config/default.yaml" | |||
| localrules: download_raw_gadm_administrative_borders, raw_gadm_administrative_borders, download_raw_nuts_units | |||
| localrules: download_eez | |||
There was a problem hiding this comment.
Is there a reason this is on a new line? I would find it easier to understand if the first line were to become a multi-line listing of localrules.
There was a problem hiding this comment.
Hmm the first line is too long. There may be other ways of splitting this into several lines with just a single localrules call, but I am not exactly sure how.
|
OK, would be good to think of a section in the documentation on how best to leverage snakemake args in Euro-Calliope (since their documentation is difficult to navigate, I find). Things like |
|
Good idea. I've opened issue #144 for that. |
…-eez-locally Fix download of EEZ to happen on local (login) node
Fixes an issue introduced in #99.
Checklist
Any checks which are not relevant to the PR can be pre-checked by the PR creator. All others should be checked by the reviewer. You can add extra checklist items here if required by the PR.