#

triton-inference-server

Here are 3 public repositories matching this topic...

YurtsAI / triton-mock

Proof-of-concept gRPC stream record-and-replay for Triton Inference Server

rust grpc triton-inference-server

Updated May 4, 2024
Rust

janwytze / InferenceStore

rust triton-inference-server inference-protocol-v2

Updated Jul 9, 2024
Rust

npuichigo / openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend

triton-inference-server openai-api llm langchain tensorrt-llm

Updated Aug 1, 2024
Rust

Improve this page

Add a description, image, and links to the triton-inference-server topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the triton-inference-server topic, visit your repo's landing page and select "manage topics."