Add MPI process stride for tasks exclusively owned by a component

[amametjanov]

This lets a component run exclusively on an MPI task: e.g. ATM on 6 MPI tasks for 6 GPUs on a Summit node.

[NML] - due to new excl_stride namelist variables

[amametjanov]

A single-node test:

$ ./pelayout
Comp  NTASKS  NTHRDS  ROOTPE PSTRIDE
CPL :     42/     1;      0      1
ATM :      6/     1;      1      7
LND :      7/     1;     21      1
ICE :     35/     1;      0      1
OCN :      7/     1;     35      1
ROF :      7/     1;     28      1
GLC :      1/     1;      0      1
WAV :      1/     1;      0      1
IAC :      1/     1;      0      1
ESP :      1/     1;      0      1

    <entry id="EXCL_STRIDE">
      <type>integer</type>
      <values>
        <value compclass="ATM">7</value>
        <value compclass="CPL">0</value>
        <value compclass="OCN">0</value>
        <value compclass="WAV">0</value>
        <value compclass="GLC">0</value>
        <value compclass="ICE">0</value>
        <value compclass="ROF">0</value>
        <value compclass="LND">0</value>
        <value compclass="ESP">0</value>
        <value compclass="IAC">0</value>
      </values>
      <desc>Stride of MPI tasks owned exclusively by a component. If 0, exclusivity is disabled.</desc>
    </entry>

$ ./xmlchange INFO_MPROF=2

$ zgrep "comps" run/cpl.log.1956863.220328-232850.gz 
 memory_write: model date =   00010101       0 memory =    1105.25 MB (highwater)        443.81 MB (usage)  (pe=    0 comps= cpl ICE GLC WAV IAC ESP)

$ zgrep "comps.*ATM" run/e3sm.log.1956863.220328-232850.gz 
1: 22:  memory_write: model date =   00010101       0 memory =     955.31 MB (highwater)        333.88 MB (usage)  (pe=   22 comps= cpl ATM)
1: 15:  memory_write: model date =   00010101       0 memory =     953.69 MB (highwater)        333.44 MB (usage)  (pe=   15 comps= cpl ATM)
1: 8:  memory_write: model date =   00010101       0 memory =     961.00 MB (highwater)        338.69 MB (usage)  (pe=    8 comps= cpl ATM)
1: 1:  memory_write: model date =   00010101       0 memory =     974.44 MB (highwater)        339.62 MB (usage)  (pe=    1 comps= cpl ATM)
1: 29:  memory_write: model date =   00010101       0 memory =     950.81 MB (highwater)        329.44 MB (usage)  (pe=   29 comps= cpl ATM)
1: 36:  memory_write: model date =   00010101       0 memory =     949.06 MB (highwater)        330.25 MB (usage)  (pe=   36 comps= cpl ATM)

$ zgrep "comps.*LND" run/e3sm.log.1956863.220328-232850.gz 
1: 21:  memory_write: model date =   00010101       0 memory =    1010.06 MB (highwater)        377.81 MB (usage)  (pe=   21 comps= cpl LND ICE)
1: 27:  memory_write: model date =   00010101       0 memory =     969.38 MB (highwater)        352.31 MB (usage)  (pe=   27 comps= cpl LND ICE)
1: 23:  memory_write: model date =   00010101       0 memory =     973.31 MB (highwater)        356.44 MB (usage)  (pe=   23 comps= cpl LND ICE)
1: 26:  memory_write: model date =   00010101       0 memory =     974.88 MB (highwater)        355.75 MB (usage)  (pe=   26 comps= cpl LND ICE)
1: 25:  memory_write: model date =   00010101       0 memory =     971.50 MB (highwater)        352.06 MB (usage)  (pe=   25 comps= cpl LND ICE)
1: 24:  memory_write: model date =   00010101       0 memory =     974.12 MB (highwater)        356.31 MB (usage)  (pe=   24 comps= cpl LND ICE)

$ zgrep "comps.*OCN" run/e3sm.log.1956863.220328-232850.gz 
1: 35:  memory_write: model date =   00010101       0 memory =     976.38 MB (highwater)        347.31 MB (usage)  (pe=   35 comps= cpl OCN)
1: 37:  memory_write: model date =   00010101       0 memory =     968.88 MB (highwater)        346.19 MB (usage)  (pe=   37 comps= cpl OCN)
1: 41:  memory_write: model date =   00010101       0 memory =     972.75 MB (highwater)        349.81 MB (usage)  (pe=   41 comps= cpl OCN)
1: 38:  memory_write: model date =   00010101       0 memory =     986.12 MB (highwater)        364.94 MB (usage)  (pe=   38 comps= cpl OCN)
1: 40:  memory_write: model date =   00010101       0 memory =    1023.88 MB (highwater)        400.88 MB (usage)  (pe=   40 comps= cpl OCN)
1: 39:  memory_write: model date =   00010101       0 memory =    1012.75 MB (highwater)        391.38 MB (usage)  (pe=   39 comps= cpl OCN)

[philipwjones]

This looks good to me. Approve by visual inspection.

[rljacob]

merged to next