Skip to content

Conversation

@Jonas-Isr
Copy link
Member

Context

We had 3 e2e tests fail multiple times:

  • 2 orchestration tests failed because of a 503 response when using a gemini model with prompt templates or response format
  • the model availability test failed due to an internal model not being supported

Feature scope:

  • switched usage from gemini model to ChatGPT model for the 2 failing test
    • The underlying issue is a known bug the orchestration team is already working on. This switch of models means we don't have to wait for a fix from their side.
  • added a list of internalOnlyModels to the models availability test

Definition of Done

  • Functionality scope stated & covered
  • Tests cover the scope above
  • Error handling created / updated & covered by the tests above
  • Aligned changes with the JavaScript SDK
  • Documentation updated
  • Release notes updated

@Jonas-Isr Jonas-Isr self-assigned this Oct 15, 2025
@Jonas-Isr Jonas-Isr added the please-review Request to review a pull-request label Oct 15, 2025
@Jonas-Isr Jonas-Isr enabled auto-merge (squash) October 15, 2025 13:39
@Jonas-Isr Jonas-Isr merged commit 97bfe57 into main Oct 17, 2025
7 checks passed
@Jonas-Isr Jonas-Isr deleted the fix-e2e-tests branch October 17, 2025 06:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

please-review Request to review a pull-request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants