Skip to content

[ES|QL][Inference] Add Cross-Cluster Search (CCS) support for all inference commands #136860

@afoucret

Description

@afoucret

Problem

The goal of this issue is to ensure that ES|QL inference commands work correctly in cross-cluster search (CCS) scenarios.

Following team discussions, we are simplifying the approach:

  • Inference always executes on the coordinator cluster receiving the query.
  • No remote execution of inference is required, and qualifiers (_coordinator, _remote) are no longer needed.
  • TEXT_EMBEDDING continues to execute on the coordinator as part of the pre-optimizer phase.

Acceptance criteria

  • Commands and function fail early if the inference endpoint does not exist on the coordinator.
  • RERANK command supports CCS searches
  • COMPLETION command supports CCS searches
  • TEXT_EMBEDDING function supports CCS searches
  • Existing CSV tests run using multi-clusters

Proposed solution

RERANK and COMPLETION:

  • Execute on the coordinator cluster.
  • Validate that the inference endpoint exists on the coordinator; fail if missing.
  • Remove any checks that previously blocked inference for remote indices.

TEXT_EMBEDDING:

  • Execution remains on the coordinator during the pre-optimizer phase.
  • No change is required for CCS

Metadata

Metadata

Assignees

Labels

:Search Relevance/ES|QLSearch functionality in ES|QL:SearchOrg/RelevanceLabel for the Search (solution/org) Relevance teamTeam:Search - RelevanceThe Search organization Search Relevance teamTeam:Search RelevanceMeta label for the Search Relevance team in Elasticsearch

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions