Skip to content

Emit events to indicate InferencePool and InferenceModel status #382

Open
@ahg-g

Description

@ahg-g

What would you like to be added:

EPP emits events to log some InferencePool and InferenceModel statuses, the two main events I can think of are:

  • InferencePool synced and accepted
  • InferenceModel accepted by the epp to be served on the referenced and matching InferencePool

Emitting events when the InferenceModel doesn't match the InferencePool is not applicable since the model likely belongs to another epp/pool.

Why is this needed:

To improve debuggability in the absence of Status updates for the short term (xref #380).

Metadata

Metadata

Assignees

Labels

lifecycle/staleDenotes an issue or PR has remained open with no activity and has become stale.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions