MiniMax M2.7是不是不支持图片识别的多模态能力啊

[liuw518]

使用open ai兼容性接口做图片识别，报错
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] Error in preprocessing prompt inputs
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] Traceback (most recent call last):
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/openai/chat_completion/serving.py", line 295, in render_chat_request
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] conversation, engine_prompts = await self._preprocess_chat(
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/openai/engine/serving.py", line 982, in _preprocess_chat
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] (conversation,), (engine_prompt,) = await renderer.render_chat_async(
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/renderers/base.py", line 755, in render_chat_async
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] for conv, prompt in await asyncio.gather(*rendered):
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/renderers/hf.py", line 682, in render_messages_async
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] conversation, mm_data, mm_uuids = await parse_chat_messages_async(
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/chat_utils.py", line 1575, in parse_chat_messages_async
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] sub_messages = _parse_chat_message_content(
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/chat_utils.py", line 1467, in _parse_chat_message_content
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] result = _parse_chat_message_content_parts(
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/chat_utils.py", line 1343, in _parse_chat_message_content_parts
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] parse_res = _parse_chat_message_content_part(
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/chat_utils.py", line 1416, in _parse_chat_message_content_part
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] mm_parser.parse_image(str_content, uuid)
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/chat_utils.py", line 906, in parse_image
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] placeholder = self._tracker.add("image", coro)
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/chat_utils.py", line 542, in add
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] self.mm_processor.info.validate_num_items(input_modality, num_items)
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/lib/python3.12/functools.py", line 998, in get
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] val = self.func(instance)
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/chat_utils.py", line 504, in mm_processor
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] return self.mm_registry.create_processor(self.model_config)
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] File "/usr/local/lib/python3.12/dist-packages/vllm/multimodal/registry.py", line 207, in create_processor
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] raise ValueError(f"{model_config.model} is not a multimodal model")
(APIServer pid=2) ERROR 04-19 16:32:34 [serving.py:311] ValueError: /root/Model/llm/MiniMax-M2.7 is not a multimodal model
(APIServer pid=2) /usr/lib/python3.12/asyncio/runners.py:118: RuntimeWarning: coroutine 'AsyncMultiModalContentParser._image_with_uuid_async' was never awaited
(APIServer pid=2) return self._loop.run_until_complete(task)
(APIServer pid=2) RuntimeWarning: Enable tracemalloc to get the object allocation traceback

[ximiximi423]

感谢反馈，图片识别需要配合多模态使用