use_parameters_and_headers

Use custom parameters and headers

Overview

The example presents a simple Add-Sub model which perform an addition and subtraction operations on passed input data and scale them using parameters and http headers send to model by client.

Example consists of following scripts:

• install.sh - install additional dependencies
• server.py - start the model with Triton Inference Server
• client.py - execute HTTP/gRPC requests to the deployed model

Quick Start

The step-by-step guide:

1. Install PyTriton following the installation instruction
2. Install the additional packages using install.sh

./install.sh

3. In current terminal start the model on Triton using server.py

./server.py

4. Open new terminal tab (ex. Ctrl + T on Ubuntu) or window
5. Go to the example directory
6. Run the client.py to perform queries on model:

./client.py