Skip to content

Commit

Permalink
Merge pull request #2 from lsst/tickets/DM-12532
Browse files Browse the repository at this point in the history
Tickets/dm 12532
  • Loading branch information
srp3rd committed Nov 8, 2017
2 parents d7f6e4d + 2cecda9 commit 5ca01e7
Show file tree
Hide file tree
Showing 2 changed files with 30 additions and 0 deletions.
29 changes: 29 additions & 0 deletions README
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,35 @@ $
Take note of the "Node set name". This is the name of machines you allocated, and you'll use
this when you submit nodes to HTCondor. This will be different each time you use allocateNodes.py.

SLURM RESERVATIONS

For Slurm users, if you have a slurm reservation, you can use the "-r" option to use it. If you have
an reservation named "res_33", the allocation would look like this:

$ allocateNodes.py -n 4 -s 24 -r res_33 -m 00:30:00 lsstvc
4 nodes will be allocated on lsstvc with 24 slots per node and maximum time limit of 00:30:00
Node set name:
srp_888
$

Note that if you do not have an allocation, and you specify one, your jobs should run anyway if there are free
nodes, since Slurm doesn't force it to run only if you have an allocation.

If you try a reservation and get the error:

$ allocateNodes.py -n 4 -s 24 -r res_43 -m 00:30:00 lsstvc
error running sbatch /scratch/srp/condor_scratch/configs/alloc_srp_2017_1107_194557.slurm
$

It is likely that you tried to use an allocation you do not have permissions to use. You can use the "-v"
option, and amoung the output you'll see a line that's something like:

sbatch: error: Batch job submission failed: Access denied to requested reservation

which verifies that is the case.

ORCA


To use this with Orca, specify the nodeset name using the "-N" option in runOrca.py. The following
command targets jobs to the "srp_450" node set, executing the command "/scratch/srp/myjob.sh" with input
Expand Down
1 change: 1 addition & 0 deletions etc/templates/generic.slurm.template
Original file line number Diff line number Diff line change
Expand Up @@ -4,5 +4,6 @@
#SBATCH -t $WALL_CLOCK
#SBATCH -n $NODE_COUNT
#SBATCH -J $NODE_SET
$RESERVATION

srun $LOCAL_SCRATCH/configs/$GENERATED_ALLOCATE_SCRIPT

0 comments on commit 5ca01e7

Please sign in to comment.