Running Charm4py on LSF - can't find cmpirun

[doncandela]

I have built charm4py with MPI on our university's cluster running LSF, but trying to run my code (boxpc.py) using

charmrun +p10 boxpc.py

get error "cmpirun: command not found". Seems the charmrun script generated the cmprirun command. Not having any luck finding cmpirun in charm4py or charm++ docs, our hpc staff says cmpirun is nowhere on the cluster even though they run a lot of NAMD. This was the output from LSF:

------------------------------------------------------------
# LSBATCH: User input
#!/bin/bash
module load openmpi/4.0.1
export pproc=c4p
charmrun +p10 boxpc.py box_test

------------------------------------------------------------

Exited with exit code 127.

Resource usage summary:

    CPU time :                                   0.28 sec.
    Max Memory :                                 9 MB
    Average Memory :                             7.75 MB
    Total Requested Memory :                     10240.00 MB
    Delta Memory :                               10231.00 MB
    Max Swap :                                   -
    Max Processes :                              4
    Max Threads :                                5
    Run time :                                   33 sec.
    Turnaround time :                            27 sec.

The output (if any) follows:

openmpi 4.0.1 is located under /share/pkg/openmpi/4.0.1

Running on 10 processors:  /home/dc82a/.conda/envs/d21m/bin/python3.7 boxpc.py box_test 
cmpirun -lsf -poll -no_smp -gm_long 200000 /home/dc82a/.conda/envs/d21m/bin/python3.7 boxpc.py box_test
/home/dc82a/.conda/envs/d21m/lib/python3.7/site-packages/charmrun/charmrun: line 115: cmpirun: command not found

[ZwFink]

Hi Don,
I'm looking into this issue with charmrun invoking cmpirun on LSF. In the meantime, you can use mpirun to run charm4py programs:

mpirun -np 10 python3 boxpc.py box_test

[ZwFink]

Hi @doncandela ,
Just wanted to follow up on this to see if the proposed resolution works.

[doncandela]

Yes, using mpirun rather than charmrun does work.