Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tickets/dm 12532 #2

Merged
merged 2 commits into from
Nov 8, 2017
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
29 changes: 29 additions & 0 deletions README
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,35 @@ $
Take note of the "Node set name". This is the name of machines you allocated, and you'll use
this when you submit nodes to HTCondor. This will be different each time you use allocateNodes.py.

SLURM RESERVATIONS

For Slurm users, if you have a slurm reservation, you can use the "-r" option to use it. If you have
an reservation named "res_33", the allocation would look like this:

$ allocateNodes.py -n 4 -s 24 -r res_33 -m 00:30:00 lsstvc
4 nodes will be allocated on lsstvc with 24 slots per node and maximum time limit of 00:30:00
Node set name:
srp_888
$

Note that if you do not have an allocation, and you specify one, your jobs should run anyway if there are free
nodes, since Slurm doesn't force it to run only if you have an allocation.

If you try a reservation and get the error:

$ allocateNodes.py -n 4 -s 24 -r res_43 -m 00:30:00 lsstvc
error running sbatch /scratch/srp/condor_scratch/configs/alloc_srp_2017_1107_194557.slurm
$

It is likely that you tried to use an allocation you do not have permissions to use. You can use the "-v"
option, and amoung the output you'll see a line that's something like:

sbatch: error: Batch job submission failed: Access denied to requested reservation

which verifies that is the case.

ORCA


To use this with Orca, specify the nodeset name using the "-N" option in runOrca.py. The following
command targets jobs to the "srp_450" node set, executing the command "/scratch/srp/myjob.sh" with input
Expand Down
1 change: 1 addition & 0 deletions etc/templates/generic.slurm.template
Original file line number Diff line number Diff line change
Expand Up @@ -4,5 +4,6 @@
#SBATCH -t $WALL_CLOCK
#SBATCH -n $NODE_COUNT
#SBATCH -J $NODE_SET
$RESERVATION

srun $LOCAL_SCRATCH/configs/$GENERATED_ALLOCATE_SCRIPT