Replies: 1 comment 3 replies
-
I do plan to handle this with {rrq}’s built-in ability to create and manage multiple queues. Different queues can have their own workers with their own resource requirements. |
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Will crew enable heterogeneous workers? Say, for instance, I have a modeling workflow with one task that needs to run on a GPU instance and a bunch of ETL and reporting tasks that can run on generic CPU nodes. Clustermq/targets don't appear to support this.
Snakemake supports per rule configuration of slurm partitions, which is a nice feature for specifying dedicated workers for a particular set of rules/targets.
Beta Was this translation helpful? Give feedback.
All reactions