Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP]6838 support generative and hovernet with TensorRT #6859

Draft
wants to merge 8 commits into
base: dev
Choose a base branch
from

Conversation

binliunls
Copy link
Contributor

Fixes #6838 .

Description

Add TensorRT support for generative unet and hovernet.

  1. For generative unet, the block is that the trt_export API only supports one input shape and corresponding batch range. Therefore this PR aims to extend the API to support multi-input.
  2. For the hovernet, the block is mainly the dict type output. To fix this issue, this PR will try to add another list type output for the hovernet, which can be controlled by an input parameter.

Types of changes

  • Non-breaking change (fix or new feature that would not break existing functionality).
  • Breaking change (fix or new feature that would cause existing functionality to change).
  • New tests added to cover the changes.
  • Integration tests passed locally by running ./runtests.sh -f -u --net --coverage.
  • Quick tests passed locally by running ./runtests.sh --quick --unittests --disttests.
  • In-line docstrings updated.
  • Documentation updated, tested make html command in the docs/ folder.

Signed-off-by: binliu <binliu@nvidia.com>
Signed-off-by: binliu <binliu@nvidia.com>
Signed-off-by: binliu <binliu@nvidia.com>
Signed-off-by: binliu <binliu@nvidia.com>
Signed-off-by: binliu <binliu@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add TensorRT conversion support for diffusion unet and hovernet
1 participant