Open
Description
Is your feature request related to a problem? Please describe.
OpenAI introduced structured output on Aug 2024, which allows user to set a response_format or a schema for the output of the LLM. This enables for more deterministic outputs. Currently prompt flow LLM node supports json mode and not structured outputs.
Describe the solution you'd like
Support for the structured output to be added in the LM node. The output could be a dictionary with the same schema that was provided as input.
Describe alternatives you've considered
Currently i have to create a python function node where i call the LLM using the openai sdk to use the structured output feature.