No prompt for ImageDescriptionGenerator

[dotMorten]

The ImageDescriptionGenerator is missing an option to make a prompt to guide the response to what sort of description is requested. The prompt could be to ignore objects in the background, or ask specific questions about the subject in the image.

When I was using the Phi3Vision model directly this was a huge benefit and opened up quite a few scenarios for analyzing images.

[connorMicrosoft]

Thanks for the feedback! We'll track this as a feature request.

[connorMicrosoft]

Can you share more details about the scenario you have in mind here?

[dotMorten]

@connorMicrosoft I'm trying to fill out a form based on an image. That requires me to be able to ask specific questions about the image, and not just get a general description.

[snickler]

@connorMicrosoft

I tried the ImageDescription against an image of me and my wife and received very different results based on the scenario. I will also note that no one is wearing glasses. I'm wearing a black and red striped shirt, kissing my wife on the cheek who is wearing a black necklace and a black and white striped/checkered shirt, with a black bracelet.

Accessibility:
The image depicts a close-up shot of a person with short, black hair and a pair of black glasses. They are wearing a black and red striped shirt with black polka dots. They have a black bracelet on their right wrist. They are leaning against another person, who is partially obscured in the background. The background appears to be a dark, possibly indoor setting with a patterned wall behind them.

Caption:
The image shows a person wearing a red and black checkered shirt and a black necklace, hugging another person.

DetailedNarration:
The image depicts a close-up shot of a person wearing a black dress with a patterned, red and black striped shirt underneanto. They are holding a black, chain-like necklace around their neck. The background appears to be indistinct, possibly blurred, which suggests the focus is on the person.

OfficeCharts:
The image shows a diagram from a document illustrating a concept or process, possibly a flowchart or a graph, with various interconnected elements and labels indicating different stages or components.