Skip to content

gpt 5.4 computer use + tool search#361

Merged
jdchawla29 merged 9 commits into
mainfrom
feature/gpt-5-4
Mar 7, 2026
Merged

gpt 5.4 computer use + tool search#361
jdchawla29 merged 9 commits into
mainfrom
feature/gpt-5-4

Conversation

@jdchawla29
Copy link
Copy Markdown
Collaborator

@jdchawla29 jdchawla29 commented Mar 6, 2026

Note

Medium Risk
Changes core agent/tool plumbing for both OpenAI and Claude (hosted tool registration, deferred tool loading, and computer-call result formatting), which could affect tool calling behavior across many workflows; also bumps the OpenAI SDK version.

Overview
Updates defaults and docs/examples to newer models (notably gpt-5.4 for OpenAIAgent, plus gpt-5.3-codex in the Codex cookbook/example) and refreshes CLI presets/tests accordingly.

Adds support for provider-hosted tools via native specs (including new ToolSearchTool), passing hosted-tool config through to OpenAI/Claude and enabling automatic defer_loading when tool counts exceed a configured threshold.

Extends OpenAI computer-use support to the GA computer tool: parses computer_call outputs (including batched actions), requires screenshots in computer tool results, and formats them as computer_call_output with acknowledged safety checks; OperatorAgent is simplified to reuse the shared implementation. Also makes CodeExecutionTool optionally supply required OpenAI code_interpreter container config and validates it at agent tool-conversion time.

Improves native spec parsing to merge nested extra fields, expands model allowlists for native shell/apply_patch, and bumps openai dependency to >=2.26.0.

Written by Cursor Bugbot for commit 5127e06. This will update automatically on new commits. Configure here.

@chatgpt-codex-connector
Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.

Comment thread hud/tools/coding/apply_patch.py
Comment thread hud/agents/claude.py
Comment thread hud/tools/computer/openai.py Outdated
Comment thread hud/agents/openai.py
Comment thread hud/tools/computer/openai.py Outdated
@jdchawla29 jdchawla29 changed the title gpt 5 4 + tool search gpt 5.4 computer use + tool search Mar 7, 2026
Comment thread hud/agents/operator.py
Comment thread hud/tools/hosted/tool_search.py
Comment thread hud/agents/openai.py
Comment thread hud/agents/openai.py
Comment thread hud/tools/computer/openai.py
@jdchawla29
Copy link
Copy Markdown
Collaborator Author

@codex review

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d202e63c77

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread hud/agents/openai.py
Comment thread hud/agents/openai.py Outdated
Copy link
Copy Markdown

@cursor cursor Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Comment thread hud/agents/openai.py
@jdchawla29 jdchawla29 merged commit 54d48c8 into main Mar 7, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant