Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Job scheduler script in documentation can be improved by using Slurm job arrays #637

Open
e-eight opened this issue Apr 26, 2024 · 1 comment
Assignees

Comments

@e-eight
Copy link

e-eight commented Apr 26, 2024

The job scheduler script for Slurm in the documentation uses a for loop to submit jobs:

#!/bin/bash

for i in {1..{n_jobs}}
do
  sbatch script_redis_worker.sh
done

However this is not necessarily optimal, particularly if n_jobs is large. It can bog down the HPC system. An alternative is to use Slurm job arrays. I recommend that the docs are updated to suggest Slurm job arrays as an alternative.

@stephanmg
Copy link
Collaborator

@e-eight thanks for the suggestion. we will update the docs accordingly.

@stephanmg stephanmg self-assigned this Apr 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants