Skip to content

FailureMode field is not fully implemetable for envoy implementations #1033

Open
@LiorLieberman

Description

@LiorLieberman

What happened:
The ExtProcPerRoute filter in Envoy is limited and does not currently support FailureModeAllow and MessageTimeout proto fields, which are available at the listener level (ExternalProcessor proto). This limitation makes it impossible to configure different failure modes per route (meaning inferencePools with different failureModes attached to the same gateway listener), although the API allows it.

How to reproduce it (as minimally and precisely as possible):
Create two inferencePools, one with failureMode: FailClose and the other one with FailOpen and use them in the same route.

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind/bugCategorizes issue or PR as related to a bug.needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions