Streamlit Dockerized Computer Vision App with Triton Inference Server and PostgreSQL database
-
Updated
May 16, 2024 - Python
Streamlit Dockerized Computer Vision App with Triton Inference Server and PostgreSQL database
Serving YOLOv5 Segmentation Model with Amazon EC2 Inf1
Triton inference server with Python backend and transformers
This repository is a code sample to serve Large Language Models (LLM) on a Google Kubernetes Engine (GKE) cluster with GPUs running NVIDIA Triton Inference Server with FasterTransformer backend.
Microservices with HTTP, Triton Inference Server, FastApi and Docker-compose
QuickStart for Deploying a Basic Model on the Triton Inference Server
Heterogeneous System ML Pipeline Scheduling Framework with Triton Inference Server as Backend
A library for interfacing with Triton.
Custom Yolov8x-cls edge model deployment and training to classify trash vs recycling.
A complete containerized setup for Triton inference server and its python client using a realistic pre-trained XGBoost classifier model.
The Sumen model integrates with Triton Inference Server
Example string processing pipeline on Triton Inference Server
An easy classification implement to explain how triton work
Triton backend is difficult for a client to use whether it's sending by rest-api or grpc. If the client wants to customize the request body then this repository would like to offer a sidecar along with rest-api and triton client on Kubernetes.
Triton Inference Server Template
An innovative project designed to provide users with an entertaining and engaging experience by comparing their facial features to those of celebrities.
An image to text model/pipeline using VIT and Transformers and deployment using Nvidia's Pytrition and Streamlit app.
📸 YOLO Serving Cookbook based on Triton Inference Server 📸
Add a description, image, and links to the triton-inference-server topic page so that developers can more easily learn about it.
To associate your repository with the triton-inference-server topic, visit your repo's landing page and select "manage topics."