[Installation]: installation succeeded but No module named 'vllm._C'

[ReginaYann]

Your current environment

My operation system is Windows, and i use anaconda3 to manage my virtual environment and site-packages. I create a new virtual environment with python 3.10.

I ran the command pip install vllm to install vllm in my system
The installation process is smooth, and it seems that i successfully installed vllm.
However, when i tried to run vllm serve "Qwen/Qwen2.5-VL-7B-Instruct", it occured such bug:

INFO 03-21 17:22:05 [__init__.py:256] Automatically detected platform cuda.
Traceback (most recent call last):
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "C:\Users\Admin\anaconda3\envs\vllm\Scripts\vllm.exe\__main__.py", line 4, in <module>
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\site-packages\vllm\__init__.py", line 11, in <module>
    from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\site-packages\vllm\engine\arg_utils.py", line 22, in <module>
    from vllm.executor.executor_base import ExecutorBase
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\site-packages\vllm\executor\executor_base.py", line 16, in <module>
    from vllm.model_executor.layers.sampler import SamplerOutput
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\site-packages\vllm\model_executor\layers\sampler.py", line 23, in <module>
    from vllm.spec_decode.metrics import SpecDecodeWorkerMetrics
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\site-packages\vllm\spec_decode\metrics.py", line 9, in <module>
    from vllm.model_executor.layers.spec_decode_base_sampler import (
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\site-packages\vllm\model_executor\layers\spec_decode_base_sampler.py", line 10, in <module>
    from vllm.platforms import current_platform
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\site-packages\vllm\platforms\__init__.py", line 288, in __getattr__
    _current_platform = resolve_obj_by_qualname(
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\site-packages\vllm\utils.py", line 1899, in resolve_obj_by_qualname
    module = importlib.import_module(module_name)
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\importlib\__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "C:\Users\Admin\anaconda3\envs\vllm\lib\site-packages\vllm\platforms\cuda.py", line 15, in <module>
    import vllm._C  # noqa
ModuleNotFoundError: No module named 'vllm._C'

How you are installing vllm

pip install vllm

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[DarkLight1337]

We don't officially support Windows, so I suggest you try installing this inside WSL.

[aarnphm]

Will close this as not planned. You should try Cyrus' suggestion here.