Archive Trac openstack namd

Openstack Namd

Legacy Trac archive page imported from openstack_namd. Source: https://genapp.rocks/wiki/wiki/openstack_namd. Review age, links, and examples before treating as current.

note for setting up namd cluster dynamically

• job sequence

  • start up a number of nodes and return their ip addresses to use as a node file
    • {{{ nova boot ... }}}
    • boot one, nfs mount, save image, restart as another instance
    • also ssh keys for web server
  • on node: nfs mount
  • security group on server for 10.x ports 111 and 2049
    • maybe more https://pario.no/2008/01/15/allow-nfs-through-iptables-on-a-redhat-system/
  • opened all on 10.0.0.0/8
  • added to iptables: {{{-A INPUT -s 10.0.0.0/8 -j ACCEPT}}}
  • /etc/exports {{{/opt 10.0.0.0/255.0.0.0(rw,async,no_root_squash)}}}
  • on compute nodes, simply mount
    • done via user_data in appconfig
    • mount 10.0.0.7:/opt /opt -o rw,noatime,nodiratime,async
  • nova secgroups:
    • headnode : global-https, localall
    • computes : sshlocalall
  • mpirun on nodes
  • when done, sync, shutdown and delete

• todo:

  • add user info/keys to image to run
  • to bypass 1st time question {{{ssh -o "StrictHostKeyChecking=no"}}}
  • mpirun on nodes
  • when done, sync, shutdown and delete

configuring a run image

• setup groups, users, key for genapp in authorized keys etc.

yum install -y environment-modules openmpi openmpi-devel nc telnet nmap psmisc

• in genapp/.ssh/config (rw----)

Host 10.0.0.*
   StrictHostKeyChecking no
   UserKnownHostsFile=/dev/null

• append to ~genapp/.bashrc

module load mpi/openmpi-x86_64

• make sure .ssh/authorized_keys is correct (4 entries right now)

ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKxbFkxb11Ky+NqpcRfunYjUGDmiS5YGF7+PGDh6R6ar2XZS3d23s/8H4TjCTKcL6GpxEvW3iSUzn+O9HI2XTAQAQskrTGtuP1UxLMF3HL0CsbLqHzW520PKGRjjvfb8YEkFpX60Z+moPfBJ2kwN7l/LpOuzdeElxr+tADODGATdkaj45K3YPSwSalnBBnGdtEzazvQaBCNgVyKo9mp7AzEHJen0MQBuMvvAHCLC08DEf1ticFmhdcMPEitXurVmqEAH0gsqCkzywfd+eH5y2ZiIy261wBUenjk14NfzgpGJbfVhnSc5F1iFxOjVKfDjT+Lziw8kW72z7PiDj5myN3 <redacted-email>
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC8Z/v/GDkLcOMYW749I8cCh8bdnVa7FmwwUjl3QeSHBaKxfImAiBry5G6siBQ0m2pk6ekP7QN16SgNg3zJOyUz9kVMPoAlxVmLU0tncmtk1HRa/oYBrUoATd7fLPLOqURhzFHoqP5wzggPD4Ms/OX9zWSM75B/0t7Q+oSGZ65S8Cr2dN9U4/5iIeOq91pPWJfMQqS62F17Q3TTLEe1rPX6UKbAxSPh2x3Qc+0BvEMGVUtAS8GAw5hS/AyKJbo7CKRATC8LLYJdRnopETRkuRPsZGpr//aKaX/UrnRPF2j+qZJxuCc1Sj2778/uhFcCAotZHMvP/qDDNDqHlMAkaiEn <redacted-email>
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHp7rQxqh8mC3fQyz7X8Wrh54OgnifBNxpbQxKJeERjJ1z1Ufo8TeaGNcT5mdO5L548aDHa4KDrzn0U9wJP292wflY15EboIV56OS70hw9Pr3zdb6Wn2nKBdcckamKoJh2m24h3GSF3vtSuag7I3hxiukiYkm4sTlsuEkWO5f5nVPVbzw98z/qLWdFp9UVPgLxtxDN08+6umm8grrHWgZlV/2u/wqcvsV/gqslgPTpJPb+N2MKV/IvH4r2dEDxvMaKt3UFlqFX21Su86VJZG9evFvEGk9s8qSJ1u/jln1IS1HiOGqDU4jTW/7ZH/ZRyPEoF/EGuQQSp7hgqd/VGECB <redacted-email>
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYgVDe5Rl3S+oqE+mDTLghzMcGGpKNIa6afB5XHqfmmBJ/g9A6YOEEebhXmlPbAmotdY/QJLB2q/f8GpnPAf1Ic9lweYG89+Di++Zzn0QCyuSOUfYY9peBfDvppV070xYv1eoHQYfscKxH1xC4E4MHu1EWb/7rsQe5re8mAfnd5ytodkM3DNDrRGE0oQobo5wk3jwzgvD6MYje9F6lzSIHs0NOvxRQQxe1cBITu0ed4faeD/WFQtsmeRJNebg4t+GnFav54hhTstvWfrK9amAowks6pz4Mnkiy3IDakN3n6Co38e41eica8++PtPERazPsSr2az3U3AB4OOQ4m2Ry5 <redacted-email>

startup instances

• devutil/openstack_jetstream/bin/os_cluster.php
• appconfig.json

    "resources" : {
        "local" : ""
        ,"oscluster" : {
            "run" : "oscluster"
            ,"properties" : {
                "flavor"       : "m1.tiny"
                ,"baseimage"     : "659a0f6c-e863-4818-a23f-86f020c2febc"
                ,"key"           : "apache"
                ,"secgroup"      : "sshlocalall"
                ,"project"       : "TG-MCB140255"
                ,"user"          : "tg457210"
                ,"password"      : "XXXXXXX"
                ,"domain"        : "tacc"
                ,"api_version"   : 3
                ,"auth_url"      : "https://jblb.jetstream-cloud.org:35357/v3"
                ,"user_data"     : "mount 10.0.0.7:/opt /opt -o rw,noatime,nodiratime,async 2>&1 > /tmp/userdata.log;service iptables stop 2>&1 > /tmp/servicestop.log"
            }
        }
    },