The model to consider.
I would like to request support for the microsoft/VibeVoice-ASR model in vLLM.
The recommended way to run VibeVoice with vLLM is through a specific Docker setup provided in the Microsoft VibeVoice repository, which often uses a plugin-based approach with specific vLLM versions (e.g., v0.14.1).
However, I have encountered the following issues. While it seems to work within the specific Docker container environment, attempting to serve the model directly using the standard vllm serve microsoft/VibeVoice-ASR command does not work, as the architecture is not natively recognized by vLLM. (vLLM version : v0.19.0)
Serve the model using the standard CLI: vllm serve microsoft/VibeVoice-ASR.
The model to consider.
I would like to request support for the microsoft/VibeVoice-ASR model in vLLM.
The recommended way to run VibeVoice with vLLM is through a specific Docker setup provided in the Microsoft VibeVoice repository, which often uses a plugin-based approach with specific vLLM versions (e.g., v0.14.1).
However, I have encountered the following issues. While it seems to work within the specific Docker container environment, attempting to serve the model directly using the standard vllm serve microsoft/VibeVoice-ASR command does not work, as the architecture is not natively recognized by vLLM. (vLLM version : v0.19.0)
Serve the model using the standard CLI: vllm serve microsoft/VibeVoice-ASR.