echo-grpc-triton

A simple API server for Triton inference server powered by echo and gRPC.

Prerequisites

• Install docker.
• Install go (Optional: If you want to run this project without Docker).

Commands

docker-compose up           # Run all services (API + Triton)
docker-compose kill         # Kill all services

Open http://localhost:8080/docs/index.html to see the API documents and to send a single request.

Press Try it out button to call any API.

References

• https://github.com/triton-inference-server/client/tree/main/src/grpc_generated/go
• https://github.com/sunhailin-Leo/triton-service-go
• https://echo.labstack.com/guide/
• https://github.com/swaggo/swag#api-operation