Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TensorRT EP] update oss parser to latest #23710

Merged
merged 13 commits into from
Feb 27, 2025
Merged

[TensorRT EP] update oss parser to latest #23710

merged 13 commits into from
Feb 27, 2025

Conversation

yf711
Copy link
Contributor

@yf711 yf711 commented Feb 14, 2025

Description

  • Update oss parser version to latest commit of 10.8-GA branch

Motivation and Context

  • Action needed to adapt latest onnx-tensorrt 10.8-GA branch to fix scatterND attribute issue and plugin.h not found issue

@yf711 yf711 requested a review from chilo-ms February 14, 2025 23:14
@chilo-ms
Copy link
Contributor

The TRT CI has building issue.

@yf711
Copy link
Contributor Author

yf711 commented Feb 18, 2025

onnx-tensorrt introduced a dependency plugin.h, which is available by tarball/zip installation (underTensorRT-tarball/python/include/impl/) but not available by linux package installation. OSS parser users who use Windows/Linux tarball installation are not affected.
Updating the logic to make sure builtin parser users are not blockedThis logic is not needed, as onnx-tensorrt is able to locate the dependency by itself

@jywu-msft
Copy link
Member

this is a bit confusing. if we publish packages built against TRT 10.8 but stay with10.7 parser?

@chilo-ms
Copy link
Contributor

chilo-ms commented Feb 19, 2025

onnx-tensorrt introduced a dependency plugin.h, which is available by tarball/zip installation (underTensorRT-tarball/python/include/impl/) but not available by linux package installation. OSS parser users who use Windows/Linux tarball installation are not affected.
Updating the logic to make sure builtin parser users are not blocked

Why previously when our CI was running with TRT 10.6 built-in parser didn't complain about this plugin.h depedency?

@yf711
Copy link
Contributor Author

yf711 commented Feb 19, 2025

onnx-tensorrt introduced a dependency plugin.h, which is available by tarball/zip installation (underTensorRT-tarball/python/include/impl/) but not available by linux package installation. OSS parser users who use Windows/Linux tarball installation are not affected.
Updating the logic to make sure builtin parser users are not blocked

Why previously when our CI was running with TRT 10.6 built-in parser didn't complain about this plugin.h depedency?

This dependency is only needed by oss parser. CIs that use Bulit-in parser have no issue even though there's no plugin.h

@chilo-ms
Copy link
Contributor

Updating the logic to make sure builtin parser users are not blocked

You mention "Updating the logic to make sure builtin parser users are not blocked", it should be oss parser, right?

@yf711
Copy link
Contributor Author

yf711 commented Feb 19, 2025

Updating the logic to make sure builtin parser users are not blocked

You mention "Updating the logic to make sure builtin parser users are not blocked", it should be oss parser, right?

I didn't mention that clearly.
The original code I added (search plugin.h without if check) was a blocker. This part is now removed, as it's not needed.

@yf711 yf711 changed the title [TensorRT EP] revert oss parser to 10.7-GA [TensorRT EP] update oss parser to latest Feb 26, 2025
@yf711 yf711 merged commit 000f2c9 into main Feb 27, 2025
93 of 95 checks passed
@yf711 yf711 deleted the yifanl/oss_fix branch February 27, 2025 01:25
amarin16 pushed a commit that referenced this pull request Feb 27, 2025
### Description
<!-- Describe your changes. -->
* Update oss parser version to latest commit of 10.8-GA branch

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

* Action needed to adapt latest onnx-tensorrt 10.8-GA branch to fix
scatterND attribute issue and `plugin.h` not found issue
amarin16 pushed a commit that referenced this pull request Feb 27, 2025
### Description
<!-- Describe your changes. -->
* Update oss parser version to latest commit of 10.8-GA branch

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

* Action needed to adapt latest onnx-tensorrt 10.8-GA branch to fix
scatterND attribute issue and `plugin.h` not found issue
amarin16 added a commit that referenced this pull request Feb 28, 2025
Cherry-pick the following changes into
[rel-1.21.0](https://github.com/microsoft/onnxruntime/tree/rel-1.21.0).
- (#23791)
- (#23710)
- (#23789)
- (#23829)

---------

Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
Co-authored-by: Yifan Li <109183385+yf711@users.noreply.github.com>
Co-authored-by: Ankit Maheshkar <ankit.maheshkar@intel.com>
Co-authored-by: n1harika <niharika.sathish@intel.com>
Co-authored-by: Changming Sun <chasun@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants