A snap package for the Slurm workload manager - a highly scalable cluster management and job scheduling system for large and small Linux clusters. Slurm is used by many of the world's supercomputers and computer clusters.
This snap is currently experimental. If you're interested in the development of this snap - and want to contribute - please reach out to me on the Ubuntu HPC Matrix space.
Slurm is a workload manager designed for supercomputers. It is scalable, highly configurable, and supports scheduling for generic computational resources such as GPUs. This snap package includes:
munged: The daemon responsible for authenticating local MUNGE clients and servicing their credential encode & decode requests.slurmctld: The central management daemon of Slurm.slurmd: The compute node daemon of Slurm.slurmdbd: The Slurm database daemon. Provides an interface to a database for Slurm.slurmrestd: The Slurm REST API daemon. Provides an interface to Slurm via a REST API.- The command line applications used to interface with both Slurm and MUNGE.
- A configuration API for dynamically configuring various Slurm functionality.
Slurm is a highly configurable workload manager. The Slurm snap can be configured using
snap set slurm .... See the list below for all the possible configuration options
you can set on the snap:
Configuration options related to the Slurm workload manager. Please refer to the parameters section of the slurm.conf configuration file manual page for an in-depth description of each configuration option and how it modifies the behaviour of Slurm.
account-storage-external-hostaccounting-storage-backup-hostaccounting-storage-enforceaccounting-storage-hostaccounting-storage-parametersaccounting-storage-passaccounting-storage-portaccounting-storage-tresaccounting-storage-typeaccounting-storage-useraccounting-store-flagsacct-gather-energy-typeacct-gather-filesystem-typeacct-gather-interconnect-typeacct-gather-node-freqacct-gather-profile-typeallow-spec-resources-usageauth-alt-parametersauth-alt-typesauth-infoauth-typebatch-start-timeoutbcast-excludebcast-parametersburst-buffer-typecli-filter-pluginscluster-namecommunication-parameterscomplete-waitcore-spec-plugincpu-freq-defcpu-freq-governorscred-typedebug-flagsdef-cpu-per-gpudef-mem-per-cpudef-mem-per-gpudef-mem-per-nodedependency-parametersdisable-root-jobseio-timeoutenforce-part-limitsepilogepilog-msg-timeepilog-slurmctldext-sensors-freqext-sensors-typefair-share-dampening-factorfederation-parametersfirst-job-idget-env-timeoutgpu-freq-defgres-typesgroup-update-forcegroup-update-timehealth-check-intervalhealth-check-node-statehealth-check-programinactive-limitincludeinteractive-step-optionsjob-acct-gather-frequencyjob-acct-gather-paramsjob-acct-gather-typejob-comp-hostjob-comp-locjob-comp-paramsjob-comp-passjob-comp-portjob-comp-typejob-comp-userjob-container-typejob-file-appendjob-requeuejob-submit-pluginskill-on-bad-exitkill-waitlaunch-parameterslicenseslog-time-formatmail-domainmail-progmax-array-sizemax-batch-requeuemax-job-countmax-job-idmax-mem-per-cpumax-mem-per-nodemax-node-countmax-step-countmax-tasks-per-nodemcs-parametersmcs-pluginmessage-timeoutmin-job-agempi-defaultmpi-paramsnode-features-pluginsover-time-limitplug-stack-configplugin-dirpower-parameterspower-pluginpreempt-exempt-timepreempt-modepreempt-parameterspreempt-typeprep-parametersprep-pluginspriority-calcp-periodpriority-decay-half-lifepriority-favor-smallpriority-flagspriority-max-agepriority-parameterspriority-site-factor-parameterspriority-site-factor-pluginpriority-typepriority-usage-reset-periodpriority-weight-agepriority-weight-assocpriority-weight-fair-sharepriority-weight-job-sizepriority-weight-partitionpriority-weight-qospriority-weight-tresprivate-dataproctrack-typeprologprolog-epilog-timeoutprolog-flagsprolog-slurmctldpropagate-prio-processpropagate-resource-limitspropagate-resource-limits-exceptreboot-programreconfig-flagsrequeue-exitrequeue-exit-holdresume-fail-programresume-programresume-rateresume-timeoutresv-epilogresv-over-runresv-prologreturn-to-serviceroute-pluginscheduler-parametersscheduler-time-slicescheduler-typescron-parametersselect-typeselect-type-parametersslurm-sched-log-fileslurm-sched-log-levelslurm-userslurmctld-addrslurmctld-debugslurmctld-hostslurmctld-log-fileslurmctld-parametersslurmctld-pid-fileslurmctld-portslurmctld-primary-off-progslurmctld-primary-on-progslurmctld-syslog-debugslurmctld-timeoutslurmd-debugslurmd-log-fileslurmd-parametersslurmd-pid-fileslurmd-portslurmd-spool-dirslurmd-syslog-debugslurmd-timeoutslurmd-usersrun-epilogsrun-port-rangesrun-prologstate-save-locationsuspend-exc-nodessuspend-exc-partssuspend-exc-statessuspend-programsuspend-ratesuspend-timesuspend-timeoutswitch-parametersswitch-typetask-epilogtask-plugintask-plugin-paramtask-prologtcp-timeouttmp-fstopology-paramtopology-plugintrack-wc-keytree-widthunkillable-step-programunkillable-step-timeoutuse-pamvsize-factorwait-timex11-parameters
Configuration options related to compute nodes. Please refer to the node configuration section of the slurm.conf configuration file manual page for an in-depth description of each configuration option and how it modifies the behaviour of compute nodes.
nodes.<node-name>.bcast-addrnodes.<node-name>.boardsnodes.<node-name>.core-spec-countnodes.<node-name>.cores-per-socketnodes.<node-name>.cpu-bindnodes.<node-name>.cpu-spec-listnodes.<node-name>.cpusnodes.<node-name>.featuresnodes.<node-name>.gresnodes.<node-name>.mem-spec-limitnodes.<node-name>.node-addrnodes.<node-name>.node-hostnamenodes.<node-name>.node-namenodes.<node-name>.portnodes.<node-name>.procsnodes.<node-name>.real-memorynodes.<node-name>.reasonnodes.<node-name>.socketsnodes.<node-name>.sockets-per-boardnodes.<node-name>.statenodes.<node-name>.threads-per-corenodes.<node-name>.tmp-disknodes.<node-name>.weight
Configuration options related to frontend compute nodes. Please refer to the frontend node configuration section of the slurm.conf configuration file manual page for an in-depth description of each configuration option and how it modifies the behaviour of frontend compute nodes.
frontend-nodes.<frontend-node-name>.allow-groupsfrontend-nodes.<frontend-node-name>.allow-usersfrontend-nodes.<frontend-node-name>.deny-groupsfrontend-nodes.<frontend-node-name>.deny-usersfrontend-nodes.<frontend-node-name>.frontend-addrfrontend-nodes.<frontend-node-name>.frontend-namefrontend-nodes.<frontend-node-name>.portfrontend-nodes.<frontend-node-name>.reasonfrontend-nodes.<frontend-node-name>.state
Configuration options related to down compute nodes. Please refer to the down node configuration section of the slurm.conf configuration file manual page for an in-depth description of each configuration option and how it modifies the behaviour of compute nodes.
down-nodes.nodesdown-nodes.reasondown-nodes.state
Configuration options related to node sets. Please refer to the nodeset configuration section of the slurm.conf configuration file manual page for an in-depth description of each configuration option and how it modifies the behaviour of node sets.
node-sets.<node-set>.featurenode-sets.<node-set>.nodes
Configuration options related to partitions. Please refer to the partition configuration section of the slurm.conf configuration file manual page for an in-depth description of each configuration option and how it modifies the behaviour of partitions.
partitions.<partition-name>.alloc-nodespartitions.<partition-name>.allow-accountspartitions.<partition-name>.allow-groupspartitions.<partition-name>.allow-qospartitions.<partition-name>.alternatepartitions.<partition-name>.cpu-bindpartitions.<partition-name>.def-cpu-per-gpupartitions.<partition-name>.def-mem-per-cpupartitions.<partition-name>.def-mem-per-gpupartitions.<partition-name>.def-mem-per-nodepartitions.<partition-name>.defaultpartitions.<partition-name>.default-timepartitions.<partition-name>.deny-accountspartitions.<partition-name>.deny-qospartitions.<partition-name>.disable-root-jobspartitions.<partition-name>.exclusive-userpartitions.<partition-name>.grace-timepartitions.<partition-name>.hiddenpartitions.<partition-name>.llnpartitions.<partition-name>.max-cpus-per-nodepartitions.<partition-name>.max-cpus-per-socketpartitions.<partition-name>.max-mem-per-cpupartitions.<partition-name>.max-mem-per-nodepartitions.<partition-name>.max-nodespartitions.<partition-name>.max-timepartitions.<partition-name>.min-nodespartitions.<partition-name>.nodespartitions.<partition-name>.over-subscribepartitions.<partition-name>.over-time-limitpartitions.<partition-name>.partition-namepartitions.<partition-name>.power-down-on-idlepartitions.<partition-name>.preempt-modepartitions.<partition-name>.priority-job-factorpartitions.<partition-name>.priority-tierpartitions.<partition-name>.qospartitions.<partition-name>.req-resvpartitions.<partition-name>.resume-timeoutpartitions.<partition-name>.root-onlypartitions.<partition-name>.select-type-parameterspartitions.<partition-name>.statepartitions.<partition-name>.suspend-timepartitions.<partition-name>.suspend-timeoutpartitions.<partition-name>.tres-billing-weights
munge.key- Set the munge.key secret use by the
mungeddaemon to authenticate hosts.
- Set the munge.key secret use by the
munge.max-thread-count- Set the maximum number of threads that
mungedcan spawn for processing authentication requests.
- Set the maximum number of threads that
slurmd.config-server- Set configuration server for
slurmd. Required when runningslurmdin configless mode. The daemon will download the slurm.conf configuration file from the primary control server.
- Set configuration server for
Configuration options related to the slurmdbd daemon. Please refer to the
slurmdbd.conf configuration file
manual page for an in-depth description of each configuration option
and how it modifies the behaviour of the slurmdbd daemon.
slurmd.archive-dirslurmd.archive-eventsslurmd.archive-jobsslurmd.archive-resvsslurmd.archive-scriptslurmd.archive-stepsslurmd.archive-suspendslurmd.archive-txnslurmd.archive-usageslurmd.auth-alt-parametersslurmd.auth-alt-typesslurmd.auth-infoslurmd.auth-typeslurmd.commit-delayslurmd.communication-parametersslurmd.dbd-addrslurmd.dbd-backup-hostslurmd.dbd-hostslurmd.dbd-portslurmd.debug-flagsslurmd.debug-levelslurmd.debug-level-syslogslurmd.default-qosslurmd.log-fileslurmd.log-time-formatslurmd.max-query-time-rangeslurmd.message-timeoutslurmd.parametersslurmd.pid-fileslurmd.plugin-dirslurmd.private-dataslurmd.purge-event-afterslurmd.purge-job-afterslurmd.purge-resv-afterslurmd.purge-step-afterslurmd.purge-suspend-afterslurmd.purge-txn-afterslurmd.purge-usage-afterslurmd.slurm-userslurmd.storage-backup-hostslurmd.storage-hostslurmd.storage-locslurmd.storage-parametersslurmd.storage-passslurmd.storage-portslurmd.storage-typeslurmd.storage-userslurmd.tcp-timeoutslurmd.track-slurmctld-downslurmd.track-wc-key
slurmrestd.max-connections- Set the maximum number of connections to process at one time.
slurmrestd.max-thread-count- Set the maximum number of threads to spawn for processing client connections.
Want to build and test the Slurm snap locally without pulling from the Snap Store? Want to bundle in your own custom Slurm plugins? Use the following commands to build and install the Slurm snap on your system. These instructions assume that you are running on a Linux distribution that supports installing snap packages. Please see this page for a list of Linux distributions that support using snap packages.
git clone git@github.com:NucciTheBoss/slurm-snap.git
cd slurm-snap
sudo snap install lxd
sudo lxd init --minimal
sudo snap install snapcraft --classic
snapcraft
sudo snap install ./slurm*.snap --dangerous --classic
The Slurm workload manager snap package is a project of the Ubuntu HPC community. It is an open source project that is welcome to community involvement, contributions, suggestions, fixes, and constructive feedback. Interested in being involved with the development of this snap package? Check out the links below:
The Slurm snap is free software, distributed under the Apache Software License, version 2.0. See LICENSE for more information. The Slurm workload manager itself is licensed under the GNU General Public License, version 2, or any later version. See Slurm's legal notice for further licensing information about Slurm itself.