Skip to content

Repository files navigation

BatchingRPCServer

Build Status

Building a tool to serve GPU-enabled tools by batching requests and processing them at once.

Depends on MXNet==0.12.0, gRPC>=1.5, protobuf>=3.5, libuuid>=1.5, cmake==3.10.0

About

Serving stateless GPU applications with batching and gRPC

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages