-
-
Notifications
You must be signed in to change notification settings - Fork 12.3k
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
🐛 Describe the bug
init_shm_manager is not implemented when NOT AVX512_FOUND, which makes it impossible to use tensor parallel on non-avx512 CPUs
Cause #15934
vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-7B -tp=2 --distributed-executor-backend mp
On CPUs without avx512 support or AVX512_DISABLED
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working