Dynamic resource allocation cluster

[t0rrant]

Is your feature request related to a problem? Please describe.
With this style of recipe, it is only possible to create a static slurm environment.

Describe the solution you'd like
A way of having a setup where we have an initial static setting, which changes as new resources need to be allocated.

Additional context
Ideas for this can be taken from https://github.com/SchedMD/slurm-gcp