From 7847b37a44864c1b90bd1ef226ffea95f17cfdd5 Mon Sep 17 00:00:00 2001 From: Iman Tabrizian Date: Thu, 1 Sep 2022 14:31:53 -0400 Subject: [PATCH] Remove PyTorch multiple instance known issue --- README.md | 8 -------- 1 file changed, 8 deletions(-) diff --git a/README.md b/README.md index da9d391..616a204 100644 --- a/README.md +++ b/README.md @@ -218,14 +218,6 @@ complex execution modes and dynamic shapes. If not specified, all are enabled by state and a restart of the server may be required to continue serving successfully. -* Multiple instances of the PyTorch model on GPU do not always - increase performance. Due to thread specific caching in PyTorch, using - multiple instances of the model interact negatively. See - [here](https://github.com/pytorch/pytorch/issues/27902) for more details. - Setting the parameter `DISABLE_OPTIMIZED_EXECUTION` to "true" in the model - configuration may help in some cases to avoid these negative interactions - due to model specific caching and increase multiple instance performance. - * PyTorch does not support Tensor of Strings but it does support models that accept a List of Strings as input(s) / produces a List of String as output(s). For these models Triton allows users to pass String input(s)/recieve String output(s) using the String