Native support for OpenAI Responses API?

[thomasdv]

Hi, is native support for Responses API planned?

That would add the ability to use built-in tools and provide details about reasoning processes. And maybe images?

Thanks.

[ilvalerione]

Images are already supported: https://docs.neuron-ai.dev/attach-images

If you are familiar with the topic you can create a PR for this feature.

[AndrewMonty]

Been tinkering with the responses API so I could use the built-in web_search_preview tool. I'll see if I can put a PR together. Might be easier to just work on a fork anyways instead of what I've been doing: extending package classes and overriding methods.

[oliverbj]

I'd like to see a way to use the responses API directly as well (my use case is the same - I'd like to use the web_search tool from OpenAI).

[AndrewMonty]

Here's my branch: https://github.com/AndrewMonty/neuron-ai/tree/openai-responses-api

Haven't gotten around to writing tests, and I'm not sure I like how streaming is handled when the agent is using a tool like web_search. Here's an example usage in a Livewire component: https://gist.github.com/AndrewMonty/68613a64c077d9efd0b58985e91526fc

[ilvalerione]

As far as I understand from the OpenAI documentation, native tools can be used with completion API: https://platform.openai.com/docs/guides/tools-web-search?api-mode=chat

In this case I have a solution in mind to be implemented in V2.

[ilvalerione]

Sorry no way. Full support only in responses API. If the API format is the same (messages, tools, etc) A flag to switch from completion to response API can be used to inform the OpenAI provider class what final endpoint to use on chat.

For setting up the web_search tool the problem is that native tools should be mixed in the tools list, but they have a different format than the normal tools.

I thought to add a method to providers withNativeTool(string|array $tool): AIProviderInterface to do the job. This method should throw an exception if the responses_api flag is false.

[ilvalerione]

@AndrewMonty starting from your openai responses implementation I created this PR that also support structured output, and provider tools (web_search, file_search, etc)

It's based on the implementation of a new provider OpenAIReponses

#291

It brings the possibility to use provider tools with other providers that have this features like Gemini and Anthropic.

It should also help for #285