Proxy server for triton gRPC server that inferences embedding model in Rust
docker
rust
docker-compose
proxy
grpc
pytorch
embeddings
restful-api
onnx
embedding-vectors
onnxruntime
ntex
triton-server
triton-client
-
Updated
Aug 10, 2024 - Rust