Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue when install on ubuntu #240

Open
cooleye72 opened this issue Jun 10, 2024 · 13 comments
Open

Issue when install on ubuntu #240

cooleye72 opened this issue Jun 10, 2024 · 13 comments
Assignees

Comments

@cooleye72
Copy link

Hi,

I am trying to install moonshot on ubuntu machine and have met the prerequisites

image
image

I encountered the following error when trying to install moonshot. Can you advise?
image

@imda-normanchia
Copy link
Collaborator

hello, thanks for trying out moonshot.

may i know what is the pip version that you are running? you can check by running pip3 --version

@cooleye72
Copy link
Author

Hi,

below is the pip version
pip3 --version
pip 22.0.2 from /usr/lib/python3/dist-packages/pip (python 3.10)

@cooleye72
Copy link
Author

I know where the issue is. The pip3 is still the old version. link to python 3.11 and it is able to install now. Thanks
image

@cooleye72
Copy link
Author

tried to install the moon ui and noticed it is unable to retrieve the environment variables. Is it the correct behavior?
image

@imda-normanchia
Copy link
Collaborator

can you try running cat .env to ensure that this configuration file was created.

if you see a value similar to this cat: .env: No such file or directory . can you try deleting moonshot-data folder and run python -m moonshot -i moonshot-data again.

else if there is value printed out similar to the codeblock below, try running python -m moonshot web to see if the same error appear.

    ATTACK_MODULES="../moonshot-data/attack-modules"
    CONNECTORS="../moonshot-data/connectors"
    CONNECTORS_ENDPOINTS="../moonshot-data/connectors-endpoints"
    CONTEXT_STRATEGY="../moonshot-data/context-strategy"
    COOKBOOKS="../moonshot-data/cookbooks"
    DATABASES="../moonshot-data/generated-outputs/databases"
    DATABASES_MODULES="../moonshot-data/databases-modules"
    DATASETS="../moonshot-data/datasets"
    IO_MODULES="../moonshot-data/io-modules"
    METRICS="../moonshot-data/metrics"
    ...

@imda-normanchia imda-normanchia self-assigned this Jun 12, 2024
@cooleye72
Copy link
Author

I ran into issue on installing h5py package when run python -m moonshot -i moonshot-data . I am using ubuntu VM on Mac ARM machine. Is there anyway to install h5py on ubuntu ARM?

image

@imda-normanchia
Copy link
Collaborator

imda-normanchia commented Jun 14, 2024

may I know which Macbook version are you using,which cpu? and if it's possible to copy paste the full error code as it is difficult to determine the issue based on the snippet above.

alternatively if you are able to install the h5py separately, do create a .env file in the folder that you are running moonshot to point to the moonshot-data repository. an example of how the .env file should look like is as below.

ATTACK_MODULES="./moonshot-data/attack-modules"
    CONNECTORS="./moonshot-data/connectors"
    CONNECTORS_ENDPOINTS="./moonshot-data/connectors-endpoints"
    CONTEXT_STRATEGY="./moonshot-data/context-strategy"
    COOKBOOKS="./moonshot-data/cookbooks"
    DATABASES="./moonshot-data/generated-outputs/databases"
    DATABASES_MODULES="./moonshot-data/databases-modules"
    DATASETS="./moonshot-data/datasets"
    IO_MODULES="./moonshot-data/io-modules"
    METRICS="./moonshot-data/metrics"
    PROMPT_TEMPLATES="./moonshot-data/prompt-templates"
    RECIPES="./moonshot-data/recipes"
    RESULTS="./moonshot-data/generated-outputs/results"
    RESULTS_MODULES="./moonshot-data/results-modules"
    RUNNERS="./moonshot-data/generated-outputs/runners"
    RUNNERS_MODULES="./moonshot-data/runners-modules"
    TOKENIZERS_PARALLELISM = false 
   
    # For Web API
    HOST_ADDRESS=127.0.0.1 # The interface the server will bind to
    HOST_PORT=5000

    # Below is the uri of the Web UI webhook.
    # In the next section, if Web UI listens on a different port,
    # update this uri accordingly and restart.

    MOONSHOT_UI_CALLBACK_URL=http://localhost:3000/api/v1/benchmarks/status

@cooleye72
Copy link
Author

I am using MacBook Pro, CPU is Apple M2 Pro. Running Ubuntu Virtual VM to install moonshot. Any compatibility issue?

@imda-normanchia
Copy link
Collaborator

While we haven't specifically tested the application in an Ubuntu VM environment on Mac OS, we can't definitively speak to any compatibility issues. We recommend that you install the version of h5py that aligns with your machine's specifications and try running moonshot again. Also, ensure to create the .env configuration file as illustrated above.

@imda-normanchia
Copy link
Collaborator

hello, would like to follow up and check if you are still having difficulty starting up moonshot. if there is no issue, I will be closing this issue.

@cooleye72
Copy link
Author

I still couldnt get it working even I create the .env folder. I guess most probably is due to h5py not compatible with M2 chip. If you manage to test ubuntu on M2 chip, please share with me the steps. Thanks!

@cooleye72
Copy link
Author

Below is the error that I encountered when re-run python -m moonshot -i moonshot-data.

`admin@ubuntu01:~$ python -m moonshot -i moonshot-data
Installing Moonshot Data from GitHub
Cloning https://github.com/aiverify-foundation/moonshot-data.git
Cloning into 'moonshot-data'...
remote: Enumerating objects: 890, done.
remote: Counting objects: 100% (159/159), done.
remote: Compressing objects: 100% (111/111), done.
remote: Total 890 (delta 58), reused 95 (delta 47), pack-reused 731
Receiving objects: 100% (890/890), 58.85 MiB | 13.65 MiB/s, done.
Resolving deltas: 100% (475/475), done.
Installing requirements for moonshot-data
Defaulting to user installation because normal site-packages is not writeable
Ignoring colorama: markers 'python_version >= "3.11" and python_version < "3.12" and (platform_system == "Windows" or sys_platform == "win32")' don't match your environment
Ignoring intel-openmp: markers 'python_version >= "3.11" and python_version < "3.12" and platform_system == "Windows"' don't match your environment
Ignoring mkl: markers 'python_version >= "3.11" and python_version < "3.12" and platform_system == "Windows"' don't match your environment
Ignoring nvidia-cublas-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-cuda-cupti-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-cuda-nvrtc-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-cuda-runtime-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-cudnn-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-cufft-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-curand-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-cusolver-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-cusparse-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-nccl-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-nvjitlink-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring nvidia-nvtx-cu12: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version >= "3.11" and python_version < "3.12"' don't match your environment
Ignoring tbb: markers 'python_version >= "3.11" and python_version < "3.12" and platform_system == "Windows"' don't match your environment
Ignoring triton: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version < "3.12" and python_version >= "3.11"' don't match your environment
Collecting absl-py==2.1.0 (from -r requirements.txt (line 1))
Using cached absl_py-2.1.0-py3-none-any.whl.metadata (2.3 kB)
Collecting accelerate==0.30.1 (from -r requirements.txt (line 2))
Using cached accelerate-0.30.1-py3-none-any.whl.metadata (18 kB)
Collecting aiohttp==3.9.5 (from -r requirements.txt (line 3))
Using cached aiohttp-3.9.5-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (7.5 kB)
Collecting aiometer==0.5.0 (from -r requirements.txt (line 4))
Using cached aiometer-0.5.0-py3-none-any.whl.metadata (12 kB)
Collecting aiosignal==1.3.1 (from -r requirements.txt (line 5))
Using cached aiosignal-1.3.1-py3-none-any.whl.metadata (4.0 kB)
Requirement already satisfied: annotated-types==0.7.0 in /home/admin/.local/lib/python3.11/site-packages (from -r requirements.txt (line 6)) (0.7.0)
Collecting anthropic==0.25.6 (from -r requirements.txt (line 7))
Using cached anthropic-0.25.6-py3-none-any.whl.metadata (18 kB)
Requirement already satisfied: anyio==4.4.0 in /home/admin/.local/lib/python3.11/site-packages (from -r requirements.txt (line 8)) (4.4.0)
Collecting anytree==2.12.1 (from -r requirements.txt (line 9))
Using cached anytree-2.12.1-py3-none-any.whl.metadata (8.1 kB)
Collecting astunparse==1.6.3 (from -r requirements.txt (line 10))
Using cached astunparse-1.6.3-py2.py3-none-any.whl.metadata (4.4 kB)
Collecting attrs==23.2.0 (from -r requirements.txt (line 11))
Using cached attrs-23.2.0-py3-none-any.whl.metadata (9.5 kB)
Collecting beautifulsoup4==4.12.3 (from -r requirements.txt (line 12))
Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting bert-score==0.3.13 (from -r requirements.txt (line 13))
Using cached bert_score-0.3.13-py3-none-any.whl.metadata (15 kB)
Collecting blis==0.7.11 (from -r requirements.txt (line 14))
Using cached blis-0.7.11-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (7.4 kB)
Collecting boto3==1.34.114 (from -r requirements.txt (line 15))
Using cached boto3-1.34.114-py3-none-any.whl.metadata (6.6 kB)
Collecting botocore==1.34.114 (from -r requirements.txt (line 16))
Using cached botocore-1.34.114-py3-none-any.whl.metadata (5.7 kB)
Collecting bpemb==0.3.5 (from -r requirements.txt (line 17))
Using cached bpemb-0.3.5-py3-none-any.whl.metadata (19 kB)
Collecting catalogue==2.0.10 (from -r requirements.txt (line 18))
Using cached catalogue-2.0.10-py3-none-any.whl.metadata (14 kB)
Collecting certifi==2024.2.2 (from -r requirements.txt (line 19))
Using cached certifi-2024.2.2-py3-none-any.whl.metadata (2.2 kB)
Collecting charset-normalizer==3.3.2 (from -r requirements.txt (line 20))
Using cached charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (33 kB)
Collecting click==8.1.7 (from -r requirements.txt (line 21))
Using cached click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting cloudpathlib==0.16.0 (from -r requirements.txt (line 22))
Using cached cloudpathlib-0.16.0-py3-none-any.whl.metadata (14 kB)
Collecting cloudpickle==3.0.0 (from -r requirements.txt (line 23))
Using cached cloudpickle-3.0.0-py3-none-any.whl.metadata (7.0 kB)
Collecting confection==0.1.4 (from -r requirements.txt (line 25))
Using cached confection-0.1.4-py3-none-any.whl.metadata (19 kB)
Collecting conllu==4.5.3 (from -r requirements.txt (line 26))
Using cached conllu-4.5.3-py2.py3-none-any.whl.metadata (19 kB)
Collecting contourpy==1.2.1 (from -r requirements.txt (line 27))
Using cached contourpy-1.2.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (5.8 kB)
Collecting cycler==0.12.1 (from -r requirements.txt (line 28))
Using cached cycler-0.12.1-py3-none-any.whl.metadata (3.8 kB)
Collecting cymem==2.0.8 (from -r requirements.txt (line 29))
Using cached cymem-2.0.8-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (8.4 kB)
Collecting datasets==2.19.1 (from -r requirements.txt (line 30))
Using cached datasets-2.19.1-py3-none-any.whl.metadata (19 kB)
Collecting deprecated==1.2.14 (from -r requirements.txt (line 31))
Using cached Deprecated-1.2.14-py2.py3-none-any.whl.metadata (5.4 kB)
Collecting dill==0.3.8 (from -r requirements.txt (line 32))
Using cached dill-0.3.8-py3-none-any.whl.metadata (10 kB)
Collecting distro==1.9.0 (from -r requirements.txt (line 33))
Using cached distro-1.9.0-py3-none-any.whl.metadata (6.8 kB)
Requirement already satisfied: docopt==0.6.2 in /usr/lib/python3/dist-packages (from -r requirements.txt (line 34)) (0.6.2)
Collecting editdistance==0.8.1 (from -r requirements.txt (line 35))
Using cached editdistance-0.8.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (3.9 kB)
Collecting eval-type-backport==0.2.0 (from -r requirements.txt (line 36))
Using cached eval_type_backport-0.2.0-py3-none-any.whl.metadata (2.2 kB)
Collecting filelock==3.14.0 (from -r requirements.txt (line 37))
Using cached filelock-3.14.0-py3-none-any.whl.metadata (2.8 kB)
Collecting flair==0.12.2 (from -r requirements.txt (line 38))
Using cached flair-0.12.2-py3-none-any.whl.metadata (12 kB)
Collecting flatbuffers==24.3.25 (from -r requirements.txt (line 39))
Using cached flatbuffers-24.3.25-py2.py3-none-any.whl.metadata (850 bytes)
Collecting fonttools==4.52.4 (from -r requirements.txt (line 40))
Using cached fonttools-4.52.4-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (161 kB)
Collecting frozenlist==1.4.1 (from -r requirements.txt (line 41))
Using cached frozenlist-1.4.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (12 kB)
Collecting fsspec==2024.3.1 (from -r requirements.txt (line 42))
Using cached fsspec-2024.3.1-py3-none-any.whl.metadata (6.8 kB)
Collecting ftfy==6.2.0 (from -r requirements.txt (line 44))
Using cached ftfy-6.2.0-py3-none-any.whl.metadata (7.3 kB)
Collecting future==1.0.0 (from -r requirements.txt (line 45))
Using cached future-1.0.0-py3-none-any.whl.metadata (4.0 kB)
Collecting gast==0.5.4 (from -r requirements.txt (line 46))
Using cached gast-0.5.4-py3-none-any.whl.metadata (1.3 kB)
Collecting gdown==4.4.0 (from -r requirements.txt (line 47))
Using cached gdown-4.4.0-py3-none-any.whl
Collecting gensim==4.3.2 (from -r requirements.txt (line 48))
Using cached gensim-4.3.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (8.3 kB)
Collecting google-pasta==0.2.0 (from -r requirements.txt (line 49))
Using cached google_pasta-0.2.0-py3-none-any.whl.metadata (814 bytes)
Collecting grpcio==1.64.0 (from -r requirements.txt (line 50))
Using cached grpcio-1.64.0-cp311-cp311-manylinux_2_17_aarch64.whl.metadata (3.3 kB)
Requirement already satisfied: h11==0.14.0 in /home/admin/.local/lib/python3.11/site-packages (from -r requirements.txt (line 51)) (0.14.0)
Collecting h5py==3.11.0 (from -r requirements.txt (line 52))
Using cached h5py-3.11.0.tar.gz (406 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... error
error: subprocess-exited-with-error

× pip subprocess to install backend dependencies did not run successfully.
│ exit code: 1
╰─> [157 lines of output]
Collecting mpi4py==3.1.4
Using cached mpi4py-3.1.4.tar.gz (2.5 MB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: mpi4py
Building wheel for mpi4py (pyproject.toml): started
Building wheel for mpi4py (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error

    × Building wheel for mpi4py (pyproject.toml) did not run successfully.
    │ exit code: 1
    ╰─> [135 lines of output]
        running bdist_wheel
        running build
        running build_src
        running build_py
        creating build
        creating build/lib.linux-aarch64-cpython-311
        creating build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/__main__.py -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/bench.py -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/run.py -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/__init__.py -> build/lib.linux-aarch64-cpython-311/mpi4py
        creating build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/__main__.py -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/pool.py -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/server.py -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/_lib.py -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/__init__.py -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/_base.py -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/_core.py -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/aplus.py -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        creating build/lib.linux-aarch64-cpython-311/mpi4py/util
        copying src/mpi4py/util/dtlib.py -> build/lib.linux-aarch64-cpython-311/mpi4py/util
        copying src/mpi4py/util/__init__.py -> build/lib.linux-aarch64-cpython-311/mpi4py/util
        copying src/mpi4py/util/pkl5.py -> build/lib.linux-aarch64-cpython-311/mpi4py/util
        copying src/mpi4py/run.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/bench.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/__main__.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/dl.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/MPI.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/__init__.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/py.typed -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/libmpi.pxd -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/MPI.pxd -> build/lib.linux-aarch64-cpython-311/mpi4py
        copying src/mpi4py/__init__.pxd -> build/lib.linux-aarch64-cpython-311/mpi4py
        creating build/lib.linux-aarch64-cpython-311/mpi4py/include
        creating build/lib.linux-aarch64-cpython-311/mpi4py/include/mpi4py
        copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-aarch64-cpython-311/mpi4py/include/mpi4py
        copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-aarch64-cpython-311/mpi4py/include/mpi4py
        copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-aarch64-cpython-311/mpi4py/include/mpi4py
        copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-aarch64-cpython-311/mpi4py/include/mpi4py
        copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-aarch64-cpython-311/mpi4py/include/mpi4py
        copying src/mpi4py/futures/pool.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/__main__.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/server.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/_core.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/_lib.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/__init__.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/futures/aplus.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py/futures
        copying src/mpi4py/util/pkl5.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py/util
        copying src/mpi4py/util/dtlib.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py/util
        copying src/mpi4py/util/__init__.pyi -> build/lib.linux-aarch64-cpython-311/mpi4py/util
        running build_clib
        MPI configuration: [mpi] from 'mpi.cfg'
        checking for library 'lmpe' ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        building 'mpe' dylib library
        creating build/temp.linux-aarch64-cpython-311
        creating build/temp.linux-aarch64-cpython-311/src
        creating build/temp.linux-aarch64-cpython-311/src/lib-pmpi
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-aarch64-cpython-311/src/lib-pmpi/mpe.o
        warning: build_clib: command 'mpicc' failed: No such file or directory

        warning: build_clib: building optional library "mpe" failed

        checking for library 'vt-mpi' ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        checking for library 'vt.mpi' ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        building 'vt' dylib library
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-aarch64-cpython-311/src/lib-pmpi/vt.o
        warning: build_clib: command 'mpicc' failed: No such file or directory

        warning: build_clib: building optional library "vt" failed

        checking for library 'vt-mpi' ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        checking for library 'vt.mpi' ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        building 'vt-mpi' dylib library
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-aarch64-cpython-311/src/lib-pmpi/vt-mpi.o
        warning: build_clib: command 'mpicc' failed: No such file or directory

        warning: build_clib: building optional library "vt-mpi" failed

        checking for library 'vt-hyb' ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        checking for library 'vt.ompi' ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        building 'vt-hyb' dylib library
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-aarch64-cpython-311/src/lib-pmpi/vt-hyb.o
        warning: build_clib: command 'mpicc' failed: No such file or directory

        warning: build_clib: building optional library "vt-hyb" failed

        running build_ext
        MPI configuration: [mpi] from 'mpi.cfg'
        checking for dlopen() availability ...
        checking for header 'dlfcn.h' ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/usr/include/python3.11 -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        failure.
        checking for library 'dl' ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/usr/include/python3.11 -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        checking for function 'dlopen' ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/usr/include/python3.11 -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        building 'mpi4py.dl' extension
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/usr/include/python3.11 -c src/dynload.c -o build/temp.linux-aarch64-cpython-311/src/dynload.o
        warning: build_ext: command 'mpicc' failed: No such file or directory

        warning: build_ext: building optional extension "mpi4py.dl" failed

        checking for MPI compile and link ...
        mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/usr/include/python3.11 -c _configtest.c -o _configtest.o
        failure.
        removing: _configtest.c _configtest.o
        error: Cannot compile MPI programs. Check your configuration!!!
        [end of output]

    note: This error originates from a subprocess, and is likely not a problem with pip.
    ERROR: Failed building wheel for mpi4py
  Failed to build mpi4py
  ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (mpi4py)
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install backend dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/home/admin/.local/lib/python3.11/site-packages/moonshot/main.py", line 198, in
main()
File "/home/admin/.local/lib/python3.11/site-packages/moonshot/main.py", line 159, in main
moonshot_data_installation()
File "/home/admin/.local/lib/python3.11/site-packages/moonshot/main.py", line 92, in moonshot_data_installation
run_subprocess(["pip", "install", "-r", "requirements.txt"], check=True)
File "/home/admin/.local/lib/python3.11/site-packages/moonshot/main.py", line 19, in run_subprocess
return subprocess.run(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip', 'install', '-r', 'requirements.txt']' returned non-zero exit status 1.`

@imda-normanchia
Copy link
Collaborator

According to the error message that you have posted, it seems that you are facing an error with the installation of this 2 package mpi4py and h5py. What you can do is that maybe you can try to install this 2 requirement separately on your own and try to run moonshot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants