Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ultralytics 8.1.46 add TensorRT 10 support #9516

Merged
merged 41 commits into from
Apr 10, 2024
Merged

ultralytics 8.1.46 add TensorRT 10 support #9516

merged 41 commits into from
Apr 10, 2024

Commits on Apr 2, 2024

  1. add support for TensorRT 10 

    only modifies existing code to keep prior functionalities in place
    @Burhan-Q
    Burhan-Q committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    0995ecd View commit details
    Browse the repository at this point in the history

  2. add TensorRT10 compatability

    @Burhan-Q
    Burhan-Q committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    4a4c68f View commit details
    Browse the repository at this point in the history

  3. Auto-format by https://ultralytics.com/actions

    @UltralyticsAssistant
    UltralyticsAssistant committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    079aa43 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    6850472 View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2024

  1. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    70c2f6b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    bc21f77 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    02c4b99 View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2024

  1. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 7, 2024
    Configuration menu
    Copy the full SHA
    94ea376 View commit details
    Browse the repository at this point in the history

  2. Update exporter.py

    @glenn-jocher
    glenn-jocher committed Apr 7, 2024
    Configuration menu
    Copy the full SHA
    8418063 View commit details
    Browse the repository at this point in the history

  3. Updates 

    Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
    @glenn-jocher
    glenn-jocher committed Apr 7, 2024
    Configuration menu
    Copy the full SHA
    32b2445 View commit details
    Browse the repository at this point in the history

  4. Add support to exporting or inference with TensorRT 10.0.0b6, and fix… 

    … bugs when exporting a tensorrt file .engine with flag half=True or when inference (#9840)

Co-authored-by: UltralyticsAssistant <web@ultralytics.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
    @ZouJiu1 @UltralyticsAssistant @glenn-jocher
    3 people committed Apr 7, 2024
    Configuration menu
    Copy the full SHA
    1f553c2 View commit details
    Browse the repository at this point in the history

  5. Update __init__.py

    @glenn-jocher
    glenn-jocher committed Apr 7, 2024
    Configuration menu
    Copy the full SHA
    d0a088d View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 7, 2024
    Configuration menu
    Copy the full SHA
    a090b75 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    4c40158 View commit details
    Browse the repository at this point in the history

  2. Removed changes from 1f553c2 due to errors, now working and fixes iss… 

    …ue with dynamic inference
    @Burhan-Q
    Burhan-Q committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    574a3a5 View commit details
    Browse the repository at this point in the history

  3. Auto-format by https://ultralytics.com/actions

    @UltralyticsAssistant
    UltralyticsAssistant committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    0964835 View commit details
    Browse the repository at this point in the history

  4. ensure max shape dimension scales no smaller than 1

    @Burhan-Q
    Burhan-Q committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    905fd05 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'trt10' of https://github.com/ultralytics/ultralytics in… 

    …to trt10
    @Burhan-Q
    Burhan-Q committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    139c2da View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    c1c0046 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    0a9a92f View commit details
    Browse the repository at this point in the history

  2. Updates 

    Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
    @glenn-jocher
    glenn-jocher committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    4e81132 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/trt10' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    a38ba95 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    0cb3053 View commit details
    Browse the repository at this point in the history

  5. Refactor constants out of for loop for speed

    @glenn-jocher
    glenn-jocher committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    2c03f83 View commit details
    Browse the repository at this point in the history

  6. Update exporter.py

    @glenn-jocher
    glenn-jocher committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    d371949 View commit details
    Browse the repository at this point in the history

  7. refactored to use unified methods

    @Burhan-Q
    Burhan-Q committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    5a5e61f View commit details
    Browse the repository at this point in the history

  8. Merge branch 'trt10' of https://github.com/ultralytics/ultralytics in… 

    …to trt10
    @Burhan-Q
    Burhan-Q committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    df6a3ff View commit details
    Browse the repository at this point in the history

  9. remove redundant line

    @Burhan-Q
    Burhan-Q committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    050b278 View commit details
    Browse the repository at this point in the history

  10. remove self. as assigned automatically

    @glenn-jocher
    glenn-jocher committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    cd18b7b View commit details
    Browse the repository at this point in the history

  11. Add TensorRT export test 

    Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
    @glenn-jocher
    glenn-jocher committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    3017bad View commit details
    Browse the repository at this point in the history

  12. Merge remote-tracking branch 'origin/trt10' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    0e694cb View commit details
    Browse the repository at this point in the history

  13. Update test_cuda.py

    @glenn-jocher
    glenn-jocher committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    d263946 View commit details
    Browse the repository at this point in the history

  14. refactored to include older interface for tensorrt<8.6

    @Burhan-Q
    Burhan-Q committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    e221ff5 View commit details
    Browse the repository at this point in the history

  15. Merge branch 'trt10' of https://github.com/ultralytics/ultralytics in… 

    …to trt10
    @Burhan-Q
    Burhan-Q committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    3bab6b4 View commit details
    Browse the repository at this point in the history

  16. refactor to include path for installs with tensorrt<8.6

    @Burhan-Q
    Burhan-Q committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    529293f View commit details
    Browse the repository at this point in the history

  17. fix dynamic where self. is needed, align else, rearrange flow

    @Burhan-Q
    Burhan-Q committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    117a011 View commit details
    Browse the repository at this point in the history

  18. correct for error with TensorRT 8.4.3.1 without method `get_tensor_sh… 

    …ape`
    @Burhan-Q
    Burhan-Q committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    1f49b5d View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. delete redundant trt10 definition

    @glenn-jocher
    glenn-jocher committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    1ef7818 View commit details
    Browse the repository at this point in the history

  2. Align variable names in Exporter and Autobackend

    @glenn-jocher
    glenn-jocher committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    9b96f5b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into trt10

    @glenn-jocher
    glenn-jocher committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    ba20133 View commit details
    Browse the repository at this point in the history

  4. move test to slow

    @glenn-jocher
    glenn-jocher committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    1fba2f3 View commit details
    Browse the repository at this point in the history