nodes(booted together, not sequential)
master01
eth0 : public
eth1 : private
compute01
eth0 : public
eth1 : private (MAC)
compute02
eth0 : public
eth1 : private (MAC)
installer user: vagrant
passwordless ssh between all nodes
ROOT MUST BE (not vagrant)
# initialize PBS path
. /etc/profile.d/pbs.sh
# enable user environment propagation (needed for modules support)
qmgr -c "set server default_qsub_arguments= -V"
# enable uniform multi-node MPI task distribution
qmgr -c "set server resources_default.place=scatter"
# enable support for job accounting
qmgr -c "set server job_history_enable=True"
# register compute hosts with pbspro
[vagrant@master01 groups.d]$ wwsh file list
dynamic_hosts : rw-r--r-- 0 root root 688 /etc/hosts
group : rw-r--r-- 1 root root 679 /etc/group
network : rw-r--r-- 1 root vagrant 16 /etc/sysconfig/network
passwd : rw-r--r-- 1 root root 1590 /etc/passwd
shadow : rw-r----- 1 root root 983 /etc/shadow
[vagrant@master01 groups.d]$ wwsh node list
NAME GROUPS IPADDR HWADDR
================================================================================
compute01 UNDEF 192.168.1.253 08:00:27:e3:b0:01
compute02 UNDEF 192.168.1.252 08:00:27:77:86:f5
[vagrant@master01 groups.d]$ sudo wwsh provision list
NODE VNFS BOOTSTRAP FILES
================================================================================
compute01 centos7.6 3.10.0-957.1.3.el7... dynamic_hosts,grou...
compute02 centos7.6 3.10.0-957.1.3.el7... dynamic_hosts,grou...
[vagrant@master01 ~]$ pdsh -w compute0[1-2] uptime
compute01: 13:42:52 up 23 min, 0 users, load average: 0.00, 0.01, 0.03
compute02: 13:42:52 up 3:25, 2 users, load average: 0.00, 0.01, 0.05
[vagrant@master01 ~]$ wwsh vnfs list
VNFS NAME SIZE (M) ARCH CHROOT LOCATION
centos7.6 279.8 x86_64 /opt/ohpc/admin/images/centos7.6
[vagrant@master01 ~]$ pbsnodes -a
compute01
Mom = compute01.localdomain
ntype = PBS
state = state-unknown,down
pcpus = 1
resources_available.host = compute01
resources_available.ncpus = 1
resources_available.vnode = compute01
resources_assigned.accelerator_memory = 0kb
resources_assigned.hbmem = 0kb
resources_assigned.mem = 0kb
resources_assigned.naccelerators = 0
resources_assigned.ncpus = 0
resources_assigned.vmem = 0kb
comment = node down: communication closed
resv_enable = True
sharing = default_shared
last_state_change_time = Sun Jul 28 11:40:41 2019
compute02
Mom = compute02
ntype = PBS
state = state-unknown,down
pcpus = 1
resources_available.host = compute02
resources_available.ncpus = 1
resources_available.vnode = compute02
resources_assigned.accelerator_memory = 0kb
resources_assigned.hbmem = 0kb
resources_assigned.mem = 0kb
resources_assigned.naccelerators = 0
resources_assigned.ncpus = 0
resources_assigned.vmem = 0kb
comment = node down: communication closed
resv_enable = True
sharing = default_shared
last_state_change_time = Sun Jul 28 11:40:41 2019
OpenHPC 1.3.8
Install guide with Warewulf + PBS Professional (PDF)
https://github.com/openhpc/ohpc/releases/download/v1.3.8.GA/Install_guide-CentOS7-Warewulf-PBSPro-1.3.8-x86_64.pdf
https://github.com/openhpc/ohpc