Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
__init__.py		__init__.py
client.py		client.py
install.sh		install.sh
server.py		server.py

README.md

Multi-Model Deployment of Python Model

Overview

The example presents a deployment of multiple Python models at the same time.

Example consists of following scripts:

install.sh - install additional dependencies
server.py - start the model with Triton Inference Server
client.py - execute HTTP/gRPC requests to the deployed model

Quick Start

The step-by-step guide:

Install PyTriton following the installation instruction
Install the additional packages using install.sh

./install.sh

In current terminal start the model on Triton using server.py

./server.py

Open new terminal tab (ex. Ctrl + T on Ubuntu) or window
Go to the example directory
Run the client.py to perform queries on model:

./client.py