Skip to content

Enable TRT multi profile option though provider option #1493

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 18 commits into from
May 21, 2025

Conversation

anujj
Copy link
Contributor

@anujj anujj commented May 19, 2025

  • Enable TRT multi profile option though provider option
  • Pass the optimization profile index though the run options
  • Hide both multi profile and cuda graph feature behind the provider option

Reviewer : @BLSharda @hanbitmyths

anujj and others added 4 commits May 20, 2025 21:41
Co-authored-by: kunal-vaishnavi <115581922+kunal-vaishnavi@users.noreply.github.com>
Co-authored-by: kunal-vaishnavi <115581922+kunal-vaishnavi@users.noreply.github.com>
Co-authored-by: kunal-vaishnavi <115581922+kunal-vaishnavi@users.noreply.github.com>
@anujj
Copy link
Contributor Author

anujj commented May 20, 2025

Thanks for the review @kunal-vaishnavi. I have addressed all the review comments

@anujj anujj requested a review from kunal-vaishnavi May 20, 2025 18:06
@anujj
Copy link
Contributor Author

anujj commented May 21, 2025

@baijumeswani : Addressed all the review comments

@anujj anujj requested a review from baijumeswani May 21, 2025 13:11
Copy link
Collaborator

@baijumeswani baijumeswani left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

minor comment. But looks good otherwise.

@anujj
Copy link
Contributor Author

anujj commented May 21, 2025

@baijumeswani : Thanks for the review, addressed the review comment

@baijumeswani baijumeswani enabled auto-merge (squash) May 21, 2025 17:59
@baijumeswani baijumeswani merged commit 290860a into microsoft:main May 21, 2025
14 checks passed
@baijumeswani baijumeswani added the 0.8.1 Patch Release for 0.8.0 label May 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.8.1 Patch Release for 0.8.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants