[bug]vllm deployement is failing on nvidia because of numpy2.0 upgrade

[balajikumaran-c-s]

Your current environment

python3.9 -c "import vllm; print(vllm.version)"

A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.0 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.

If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.

Traceback (most recent call last): File "", line 1, in
File "/usr/local/lib64/python3.9/site-packages/vllm/init.py", line 3, in
from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
File "/usr/local/lib64/python3.9/site-packages/vllm/engine/arg_utils.py", line 6, in
from vllm.config import (CacheConfig, DeviceConfig, LoRAConfig, ModelConfig,
File "/usr/local/lib64/python3.9/site-packages/vllm/config.py", line 7, in
import torch
File "/usr/local/lib64/python3.9/site-packages/torch/init.py", line 1382, in
from .functional import * # noqa: F403
File "/usr/local/lib64/python3.9/site-packages/torch/functional.py", line 7, in
import torch.nn.functional as F
File "/usr/local/lib64/python3.9/site-packages/torch/nn/init.py", line 1, in
from .modules import * # noqa: F403
File "/usr/local/lib64/python3.9/site-packages/torch/nn/modules/init.py", line 35, in
from .transformer import TransformerEncoder, TransformerDecoder,
File "/usr/local/lib64/python3.9/site-packages/torch/nn/modules/transformer.py", line 20, in
device: torch.device = torch.device(torch._C._get_default_device()), # torch.device('cpu'),
/usr/local/lib64/python3.9/site-packages/torch/nn/modules/transformer.py:20: UserWarning: Failed to initialize NumPy: _ARRAY_API not found (Triggered internal ly at ../torch/csrc/utils/tensor_numpy.cpp:84.)
device: torch.device = torch.device(torch._C._get_default_device()), # torch.device('cpu'),
ERROR 06-17 06:23:53 pynccl.py:53] Failed to load NCCL library from libnccl.so.2 .It is expected if you are not running on NVIDIA/AMD GPUs.Otherwise please se t the environment variable VLLM_NCCL_SO_PATH to point to the correct nccl library path.
INFO 06-17 06:23:53 pynccl_utils.py:17] Failed to import NCCL library: libnccl.so.2: cannot open shared object file: No such file or directory
INFO 06-17 06:23:53 pynccl_utils.py:18] It is expected if you are not running on NVIDIA GPUs.

How you are installing vllm

pip install -vvv vllm

[DarkLight1337]

Fixed by #5582

[RubTalha]

https://stackoverflow.com/questions/78641150/a-module-that-was-compiled-using-numpy-1-x-cannot-be-run-in-numpy-2-0-0