Repository navigation
Support multiple user messages in preprocessing dataset #21
Description
Activity
Ah interesting I noted the backend does not support this I believe because it just finds
{role}_messageforuserorassistantorsysteminstead of having likeuser_message_1(which is partially the method I used for multiple images).Should be a simple fix but I worry if this will conflict with changes in preprocessing in #22
After checking the code changes in #22, it seems it will conflict, at least creating a merge conflict. I guess we should implement this later, after #22 is merged.
If this is the case, we can actually merge gemma-facet/frontend-ui#11 before the demo?
Thanks for the spike, I'll try to merge #22 ASAP since it's only testing left!
Reacted by Adarsh DubeyChange this config:
{ "config": { "vision_enabled": true, "field_mappings": { "user_field": { "type": "template", "value": "Compare these images and tell me the differences." }, "assistant_field": { "type": "column", "value": "comparison" }, "image_field_1": { "type": "image", "value": "image1" }, "image_field_2": { "type": "image", "value": "image2" }, "image_field_3": { "type": "image", "value": "image3" } } } }- Make user_field a list of type either image, column, or template and remove image_field_x
- First validate if the response require only one "role": "user" message or multiple
- changed the title
[-][feature] Support multiple user messages in preprocessing dataset[/-][+]Support multiple user messages in preprocessing dataset[/+]on Aug 14, 2025 Closed as in #10
Currently the dataset processing service expects only one user message, however there should be support for multiple user messages.
However, first this needs testing, as the service might already support multiple user messages.
Tasks:
Note: This feature is also being tracked on the frontend at gemma-facet/frontend-ui#9