[Bug]: AttributeError: 'OpenVINOWorker' object has no attribute 'cache_engine'

[gavrissh]

Your current environment

The output of `python collect_env.py`

Your output of `python collect_env.py` here
No module named 'vllm._version'
  from vllm.version import __version__ as VLLM_VERSION
INFO 02-05 18:37:22 __init__.py:183] Automatically detected platform openvino.
Collecting environment information...
PyTorch version: 2.5.1+cu124
Is debug build: False
CUDA used to build PyTorch: 12.4
ROCM used to build PyTorch: N/A

OS: Ubuntu 24.04.1 LTS (x86_64)
GCC version: (Ubuntu 9.5.0-6ubuntu2) 9.5.0
Clang version: Could not collect
CMake version: version 3.31.4
Libc version: glibc-2.39

Python version: 3.12.3 (main, Jan 17 2025, 18:03:48) [GCC 13.3.0] (64-bit runtime)
Python platform: Linux-6.8.0-48-generic-x86_64-with-glibc2.39
Is CUDA available: False
CUDA runtime version: 12.0.140
CUDA_MODULE_LOADING set to: N/A
GPU models and configuration: Could not collect
Nvidia driver version: Could not collect
cuDNN version: Could not collect
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Architecture:                         x86_64
CPU op-mode(s):                       32-bit, 64-bit
Address sizes:                        48 bits physical, 48 bits virtual
Byte Order:                           Little Endian
CPU(s):                               24
On-line CPU(s) list:                  0-23
Vendor ID:                            AuthenticAMD
Model name:                           AMD EPYC-Rome-v4 Processor (no XSAVES)
CPU family:                           23
Model:                                49
Thread(s) per core:                   1
Core(s) per socket:                   1
Socket(s):                            24
Stepping:                             0
BogoMIPS:                             4992.49
Flags:                                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat umip rdpid
Hypervisor vendor:                    KVM
Virtualization type:                  full
L1d cache:                            768 KiB (24 instances)
L1i cache:                            768 KiB (24 instances)
L2 cache:                             12 MiB (24 instances)
L3 cache:                             384 MiB (24 instances)
NUMA node(s):                         1
NUMA node0 CPU(s):                    0-23
Vulnerability Gather data sampling:   Not affected
Vulnerability Itlb multihit:          Not affected
Vulnerability L1tf:                   Not affected
Vulnerability Mds:                    Not affected
Vulnerability Meltdown:               Not affected
Vulnerability Mmio stale data:        Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed:               Mitigation; untrained return thunk; SMT disabled
Vulnerability Spec rstack overflow:   Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:      Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:             Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:             Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                  Not affected
Vulnerability Tsx async abort:        Not affected

Versions of relevant libraries:
[pip3] flake8==7.1.1
[pip3] mypy==0.991
[pip3] mypy-extensions==1.0.0
[pip3] numpy==1.26.4
[pip3] nvidia-cublas-cu12==12.4.5.8
[pip3] nvidia-cuda-cupti-cu12==12.4.127
[pip3] nvidia-cuda-nvrtc-cu12==12.4.127
[pip3] nvidia-cuda-runtime-cu12==12.4.127
[pip3] nvidia-cudnn-cu12==9.1.0.70
[pip3] nvidia-cufft-cu12==11.2.1.3
[pip3] nvidia-curand-cu12==10.3.5.147
[pip3] nvidia-cusolver-cu12==11.6.1.9
[pip3] nvidia-cusparse-cu12==12.3.1.170
[pip3] nvidia-ml-py==12.570.86
[pip3] nvidia-nccl-cu12==2.21.5
[pip3] nvidia-nvjitlink-cu12==12.4.127
[pip3] nvidia-nvtx-cu12==12.4.127
[pip3] onnx==1.17.0
[pip3] pyzmq==26.2.1
[pip3] torch==2.5.1
[pip3] torchaudio==2.5.1
[pip3] torchvision==0.20.1
[pip3] transformers==4.48.2
[pip3] triton==3.1.0
[conda] Could not collect
ROCM Version: Could not collect
Neuron SDK Version: N/A
vLLM Version: 0.7.2
vLLM Build Flags:
CUDA Archs: Not Set; ROCm: Disabled; Neuron: Disabled
GPU Topology:
Could not collect

LD_LIBRARY_PATH=/home/lib/python3.12/site-packages/cv2/../../lib64:
NCCL_CUMEM_ENABLE=0
TORCHINDUCTOR_COMPILE_THREADS=1

🐛 Describe the bug

Getting the following error while inferencing an embedding model with OpenVino

ERROR 02-14 11:10:20 engine.py:139] AttributeError("'OpenVINOWorker' object has no attribute 'cache_engine'")
ERROR 02-14 11:10:20 engine.py:139] Traceback (most recent call last):
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/vllm/engine/multiprocessing/engine.py", line 137, in start
ERROR 02-14 11:10:20 engine.py:139]     self.run_engine_loop()
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/vllm/engine/multiprocessing/engine.py", line 200, in run_engine_loop
ERROR 02-14 11:10:20 engine.py:139]     request_outputs = self.engine_step()
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/vllm/engine/multiprocessing/engine.py", line 218, in engine_step
ERROR 02-14 11:10:20 engine.py:139]     raise e
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/vllm/engine/multiprocessing/engine.py", line 209, in engine_step
ERROR 02-14 11:10:20 engine.py:139]     return self.engine.step()
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 1386, in step
ERROR 02-14 11:10:20 engine.py:139]     outputs = self.model_executor.execute_model(
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/vllm/executor/executor_base.py", line 138, in execute_model
ERROR 02-14 11:10:20 engine.py:139]     output = self.collective_rpc("execute_model",
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/vllm/executor/uniproc_executor.py", line 51, in collective_rpc
ERROR 02-14 11:10:20 engine.py:139]     answer = run_method(self.driver_worker, method, args, kwargs)
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/vllm/utils.py", line 2220, in run_method
ERROR 02-14 11:10:20 engine.py:139]     return func(*args, **kwargs)
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
ERROR 02-14 11:10:20 engine.py:139]     return func(*args, **kwargs)
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/vllm/worker/openvino_worker.py", line 408, in execute_model
ERROR 02-14 11:10:20 engine.py:139]     self.cache_copy(blocks_to_copy)
ERROR 02-14 11:10:20 engine.py:139]   File "/home/lib/python3.10/site-packages/vllm/worker/openvino_worker.py", line 365, in cache_copy
ERROR 02-14 11:10:20 engine.py:139]     self.cache_engine.copy(blocks_to_copy)  # type: ignore
ERROR 02-14 11:10:20 engine.py:139] AttributeError: 'OpenVINOWorker' object has no attribute 'cache_engine'

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[github-actions]

This issue has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this issue should remain open. Thank you!

[github-actions]

This issue has been automatically closed due to inactivity. Please feel free to reopen if you feel it is still relevant. Thank you!