Skip to content

Add integration tests on error cases #325

Open
@liu-cong

Description

@liu-cong

Hermetic test is a fast way to verify functionality e2e without requiring a real cluster.

Add the following cases to make sure the EPP can correctly handle the errors.

  • Test when requested model is not found in InferenceModel
  • Test InferenceModel has a different InferencePool than the poolName flag passed to EPP - this should be the same as the InferenceModel doesn't exist
  • Test when no backend pods are available
  • Test invalid request payload (e.g., doesn't contain "model")
  • Test backend server error, client should receive an error with an appropriate error code

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.kind/cleanupCategorizes issue or PR as related to cleaning up code, process, or technical debt.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions