-
Notifications
You must be signed in to change notification settings - Fork 376
Closed
Labels
questionFurther information is requestedFurther information is requested
Description
1)My model : out1, out2 = model(input1, input2)
2)How should i set compile settings, just like this:
trt_ts_module = torch_tensorrt.compile(torch_script_module,
inputs = [example_tensor, # Provide example tensor for input shape or...
torch_tensorrt.Input( # Specify input object with shape and dtype
min_shape=[1, 3, 224, 224],
opt_shape=[1, 3, 512, 512],
max_shape=[1, 3, 1024, 1024],
# For static size shape=[1, 3, 224, 224]
dtype=torch.half) # Datatype of input tensor. Allowed options torch.(float|half|int8|int32|bool)
],
enabled_precisions = {torch.half}, # Run with FP16)
Metadata
Metadata
Assignees
Labels
questionFurther information is requestedFurther information is requested