Skip to content

Triton Model Navigator v0.7.0

Compare
Choose a tag to compare
@ptarasiewiczNV ptarasiewiczNV released this 11 Aug 13:55
· 111 commits to main since this release
  • new: Inplace Optimize feature - optimize models directly in the Python code

  • new: Non-tensor inputs and outputs support

  • new: Model warmup support in Triton model configuration

  • new: nav.tensorrt.optimize api added for testing and measuring performance of TensorRT models

  • new: Extended custom configs to pass arguments directly to export and conversion operations like torch.onnx.export or polygraphy convert

  • new: Collect GPU clock during model profiling

  • new: Add option to configure minimal trials and stabilization windows for performance verification and profiling

  • change: Navigator package version change to 0.2.3. Custom configurations now use trt_profiles list instead single value

  • change: Store separate reproduction scripts for runners used during correctness and profiling

  • Version of external components used during testing: