Skip to content

Conversation

@steven10a
Copy link
Collaborator

  • Removed nano from the benchmark results
  • Updated graphs to not include nano models
  • Removed from any examples or code snippets in the docs

Copilot AI review requested due to automatic review settings November 4, 2025 16:29
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR removes references to deprecated "nano" model variants (gpt-4.1-nano and gpt-5-nano) throughout the codebase, replacing them with "mini" variants where appropriate. This appears to be a cleanup effort to deprecate support for these model versions.

  • Removed gpt-4.1-nano and gpt-5-nano from the default benchmark models list
  • Updated all example code and tests to use gpt-4.1-mini instead of gpt-4.1-nano
  • Cleaned up documentation tables to remove nano model benchmark results

Reviewed Changes

Copilot reviewed 19 out of 23 changed files in this pull request and generated no comments.

Show a summary per file
File Description
src/guardrails/evals/guardrail_evals.py Removed nano variants from DEFAULT_BENCHMARK_MODELS list and updated help text
src/guardrails/evals/README.md Removed gpt-5-nano from example commands
src/guardrails/checks/text/jailbreak.py Updated documentation example to use gpt-4.1-mini instead of gpt-4.1-nano
tests/integration/test_suite.py Replaced all gpt-4.1-nano references with gpt-4.1-mini in test configurations
examples/implementation_code/streaming/*.py Updated streaming examples to use gpt-4.1-mini
examples/implementation_code/blocking/*.py Updated blocking examples to use gpt-4.1-mini
examples/basic/*.py Updated all basic examples to use gpt-4.1-mini
docs/ref/checks/*.md Removed nano model entries from performance benchmark tables and updated formatting
docs/evals.md Removed gpt-5-nano from example command

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copy link
Collaborator

@gabor-openai gabor-openai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TY!

@gabor-openai gabor-openai merged commit 0a65199 into main Nov 4, 2025
9 checks passed
@gabor-openai gabor-openai deleted the dev/steven/remove_nano branch November 4, 2025 18:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants