index.rst

Dynamic Batcher: a Flexible Batch Processing Daemon

Release:	|release|

Overview

dynamic-batcher is a request handling tool to gather multiple requests together for batch processing. It is designed to handle model infereneces using GPU simultaneously, as parallel.

.. toctree::
   :maxdepth: 4
   :caption: How-to Guide

   examples

.. toctree::
   :maxdepth: 3
   :caption: Modules

   dynamic_batcher

Indices and tables

• :ref:`genindex`
• :ref:`modindex`
• :ref:`search`