You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
| min/max | Minimum/maximum input of the model | In form, it can be `1`, `1x3x224x224`, or `1,1` (for multi-input networks). Sorted in lexicographic order;<br />When `instance_num > 1`, it can be multiple configurations separated by `;`. |
131
+
| min/max | Minimum/maximum input of the model | In form, it can be `1`, `1x3x224x224`, or `1,1` (for multi-input networks). <br />When `instance_num > 1`, it can be multiple configurations separated by `;`. |
132
132
| precision | Model precision |[fp32,fp16,int8,best]. The default value for versions <=0.3.1b1isfp16,andforversions >0.3.1b1 it is [fp16(SM>6.1), fp32(SM<=6.1)];Iftheprecisionisnotsupported,itwillautomaticallydegradetoasupportedprecision.|
133
133
| precision::fp32 | Set the precision of some layers to fp32 (overrides the precision setting) | Layer name(s) (can provide only part of the name), separated by commas. |
134
134
| precision::fp16 | Set the precision of some layers to fp16 (overrides the precision setting) | Layer name(s) (can provide only part of the name), separated by commas. |
@@ -155,8 +155,8 @@ See [example](https://github.com/torchpipe/torchpipe/tree/main/examples/int8).
| TASK_DATA_KEY | When the network has a single input and output, the type is at::Tensor/torch.Tensor. When the network has multiple inputs and outputs, the type is vector/List. | Sorted in lexicographic order |
159
-
| TASK_RESULT_KEY (Output) | The output type is the same as the input type, and the postprocessor can customize the output. | Sorted in lexicographic order |
158
+
| TASK_DATA_KEY | When the network has a single input and output, the type is at::Tensor/torch.Tensor. When the network has multiple inputs and outputs, the type is vector/List. | Sorted in lexicographic order for trt<=9|
159
+
| TASK_RESULT_KEY (Output) | The output type is the same as the input type, and the postprocessor can customize the output. | Sorted in lexicographic order for trt<=9|
0 commit comments