Issue: Error Code 422 When Sending Chat Messages Containing Images in Azure OpenAI Pipeline

[Wenlin88]

When using the Azure OpenAI pipeline, attempting to send a chat message that contains an image results in a 422 Un processable Entity error. This issue occurs most probably because the current OpenAIChatMessage schema does not support image inputs, leading to validation failures.

Open WebUI Version
v0.3.5

Pipelines
commit df2124e

[justinh-rahb]

Vision can be disabled per model in Workspace > Models:

[Wenlin88]

My current understanding is that it is not coming from this, but more from the fact that image content is in dictionary from WebUI side.

Due that I added to schemas.py:

class ImageContent(BaseModel):
    type: str
    image_url: dict

class TextContent(BaseModel):
    type: str
    text: str

class MessageContent(RootModel):
    root: Union[TextContent, ImageContent]

[Wenlin88]

#104