Skip to content

Commit

Permalink
fix(docs): Change V2 Inference Protocol to OIP (#5297)
Browse files Browse the repository at this point in the history
* Change from V2 protocol to OIP

* Add back endpoint categories for clarity

* Grammar

* Add model inference under endpoints
  • Loading branch information
paulb-seldon committed Feb 8, 2024
1 parent 7ef404c commit 33dc760
Showing 1 changed file with 7 additions and 8 deletions.
15 changes: 7 additions & 8 deletions doc/source/reference/apis/v2-protocol.md
Original file line number Diff line number Diff line change
@@ -1,18 +1,17 @@
# V2 Inference Protocol
# Open Inference Protocol

The V2 Inference Protocol is an industry-wide effort to provide an standardised
The Open Inference Protocol is an industry-wide effort to provide a standardized
protocol to communicate with different inference servers (e.g. MLServer,
Triton, etc.) and orchestrating frameworks (e.g. Seldon Core, KServe, etc.).
The spec of the V2 Inference Protocol defines both the endpoints and payload
The spec of the Open Inference Protocol defines both the endpoints and payload
schemas for REST and gRPC interfaces.

As part of the V2 Protocol definition, you can find dedicated endpoints for:
As part of the Open Inference Protocol definition, you can find dedicated endpoints for:

- Health endpoints, to assess liveness and readiness of your model.
- Inference endpoints, to interact with your model.
- Metadata endpoints, to query your model metadata (e.g. expected inputs, expected
- Model controls: Call model inference, interact with your model, and load and unload models dynamically
- Health: Assess liveness and readiness of your model.
- Metadata: Query your model metadata (e.g. expected inputs, expected
outputs, etc.).
- Model repository endpoints, to load and unload models dynamically.


## REST
Expand Down

0 comments on commit 33dc760

Please sign in to comment.