Skip to content

Conversation

@joseharriaga
Copy link
Collaborator

  • Extend delays for VectorStore tests to mitigate flakiness
  • Upgrade Moderation tests to the new omni-moderation-latest model to avoid failures when using the older text-moderation-stable model
  • Move image generation tool in Responses to ResponsesToolTests.cs
  • Add a delay to file search tool test in Responses to mitigate flakiness
  • Re-record as needed

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR updates the moderations tests to use the new omni-moderation-latest model instead of the deprecated text-moderation-stable model. The changes include:

  • Updating the default model for moderations test scenarios
  • Adjusting test assertions to match the new model's score thresholds
  • Updating session recordings to reflect the new API responses
  • Reorganizing test methods between test files
  • Adding necessary delays for consistency in vector store tests

Reviewed Changes

Copilot reviewed 11 out of 21 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
tests/Utility/TestHelpers.cs Updates default moderation model from "text-moderation-stable" to "omni-moderation-latest"
tests/Moderations/ModerationsTests.cs Adjusts violence score thresholds from 0.5 to 0.2 and updates model name assertion
tests/SessionRecords/ModerationsTests/*.json Updates recorded API responses for the new omni-moderation model with additional fields
tests/SessionRecords/VectorStoresTests/*.json Updates session recordings with new test data and reduced file counts
tests/Responses/ResponsesToolTests.cs Adds System.Threading using statement and moves image generation tests from ResponsesTests
tests/Responses/ResponsesTests.cs Removes image generation tests (moved to ResponsesToolTests)
tests/Assistants/Assistants.VectorStoresTests.cs Increases delays from 1-2 seconds to 10 seconds for vector store operations

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

joseharriaga and others added 2 commits October 30, 2025 16:48
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@joseharriaga joseharriaga merged commit b1ad4b1 into main Oct 30, 2025
1 check passed
@joseharriaga joseharriaga deleted the joseharriaga/FixLiveTests branch October 30, 2025 23:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants