Skip to content

EAI-7243: forward x-ai-eg-backend for header-less metric attribution - #795

Merged
johnl-amd merged 1 commit into
bump_version_envoy_and_ai_gatewayfrom
prototype-forward-backend-sp
Aug 4, 2026
Merged

EAI-7243: forward x-ai-eg-backend for header-less metric attribution#795
johnl-amd merged 1 commit into
bump_version_envoy_and_ai_gatewayfrom
prototype-forward-backend-sp

Conversation

@johnl-amd

@johnl-amd johnl-amd commented Aug 4, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Adds x-ai-eg-backend to the default-deny SecurityPolicy's headersToBackend.
  • This lets the resolved backend that discovery forwards (silogen/core#4309) reach the ext_proc, which stamps aim_service_id on the header-less/body path — the label went empty when cluster-auth was removed (the gateway can't resolve the backend from EDS endpoint metadata for InferencePool/Service clusters).

Merge order

Notes

  • Deploy order is independent of core#4309: if only one side ships the feature is simply inert (old discovery returns no header for this SP to forward; new discovery returns a header the old SP drops) — no breakage either way.
  • No spoofing risk: a client that sends x-ai-eg-backend is on the header path (per-backend SP + native apiKeyAuth) and never hits this extAuth; headersToBackend only applies to discovery's response on the body path, where discovery is authoritative.

Verification (live, app-dev)

Deployed alongside core#4309; header-less traffic (valid key, no routing headers) populated aim_service_id with the correct backend — keyed metric series grew on the populated series with no empty-backend series appearing.

Risk

Low. Single additive header entry on one gateway-scoped SecurityPolicy.

Add x-ai-eg-backend to the default-deny SP's headersToBackend so the resolved
backend that discovery forwards (core #4309) reaches the ext_proc and populates
aim_service_id on the header-less path, where the gateway can't resolve the
backend from EDS endpoint metadata.

Stacked on the bump branch (that's where the default-deny SP lives); retarget to
main after #794 merges.
@johnl-amd
johnl-amd force-pushed the prototype-forward-backend-sp branch from 23c611e to be59cff Compare August 4, 2026 09:23
@johnl-amd johnl-amd changed the title prototype: forward x-ai-eg-backend for header-less metric attribution (EAI-7243) EAI-7243: forward x-ai-eg-backend for header-less metric attribution Aug 4, 2026
@johnl-amd
johnl-amd marked this pull request as ready for review August 4, 2026 09:23
@johnl-amd
johnl-amd requested a review from a team as a code owner August 4, 2026 09:23
@johnl-amd
johnl-amd merged commit 95bd89a into bump_version_envoy_and_ai_gateway Aug 4, 2026
14 checks passed
@johnl-amd
johnl-amd deleted the prototype-forward-backend-sp branch August 4, 2026 10:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant