New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[ML] External inference service rolling upgrade tests #107619
Conversation
Pinging @elastic/ml-core (Team:ML) |
} | ||
|
||
@SuppressWarnings("unchecked") | ||
@AwaitsFix(bugUrl = "Cannot set the URL in the tests") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah that's a bummer, is there a way to set some config flag for a test build of elasticsearch that we can then expose a url field? That way in production builds we won't allow it
...pgrade/src/javaRestTest/java/org/elasticsearch/xpack/application/CohereServiceUpgradeIT.java
Show resolved
Hide resolved
...pgrade/src/javaRestTest/java/org/elasticsearch/xpack/application/CohereServiceUpgradeIT.java
Show resolved
Hide resolved
...lasticsearch/xpack/inference/services/openai/embeddings/OpenAiEmbeddingsServiceSettings.java
Show resolved
Hide resolved
...e/src/javaRestTest/java/org/elasticsearch/xpack/application/AzureOpenAiServiceUpgradeIT.java
Show resolved
Hide resolved
} | ||
|
||
@SuppressWarnings("unchecked") | ||
@AwaitsFix(bugUrl = "Cannot set the URL in the tests") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The Azure OpenAI config does not allow a user settable URL which means it can't be tested with the mock web server. Either we enable that for these tests or find some other way of setting the URL
...pgrade/src/javaRestTest/java/org/elasticsearch/xpack/application/CohereServiceUpgradeIT.java
Show resolved
Hide resolved
...e/src/javaRestTest/java/org/elasticsearch/xpack/application/AzureOpenAiServiceUpgradeIT.java
Show resolved
Hide resolved
@elasticmachine update branch |
@elasticmachine update branch |
Rolling upgrade tests for OpenAI, Cohere and Hugging Face. The services are tested by setting the services' url to a local mock web server and mocking the responses.
💚 Backport successful
|
#107868) * [ML] External inference service rolling upgrade tests (#107619) Rolling upgrade tests for OpenAI, Cohere and Hugging Face. The services are tested by setting the services' url to a local mock web server and mocking the responses. * fix compilation * Reduce inference rolling upgrade test parallelism --------- Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> Co-authored-by: Mark Vieira <portugee@gmail.com>
Rolling upgrade tests for OpenAI, Azure, Cohere and Hugging Face. The services are tested by setting the services' url to a local mock web server and mocking the responses.
The tests exposed 1 issue for OpenAI where an older model that does not have the
dimensionsSetByUser
field throws an validation error.