Skip to content

Adds automatic loading of the external tensorrt_plugins library in the TensorRT-RTX Execution Provider to support custom transformer plugins#26558

Merged
chilo-ms merged 1 commit intomicrosoft:mainfrom
anujj:nv_ep_external_plugins
Nov 13, 2025
Merged

Adds automatic loading of the external tensorrt_plugins library in the TensorRT-RTX Execution Provider to support custom transformer plugins#26558
chilo-ms merged 1 commit intomicrosoft:mainfrom
anujj:nv_ep_external_plugins

Conversation

@anujj
Copy link
Contributor

@anujj anujj commented Nov 12, 2025

External TensorRT plugins for transformer models were previously only available as internal TensorRT components. To enable flexible deployment these plugins have been externalized into a separate library.

@anujj
Copy link
Contributor Author

anujj commented Nov 12, 2025

@gaugarg-nv @ishwar-raut1 @chilo-ms @edgchen1 for review

@chilo-ms
Copy link
Contributor

/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline,Windows x64 QNN CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

@anujj
Copy link
Contributor Author

anujj commented Nov 13, 2025

@chilo-ms : can we merge this change, please ?

@chilo-ms chilo-ms merged commit 907ede2 into microsoft:main Nov 13, 2025
90 checks passed
Rohanjames1997 pushed a commit to Rohanjames1997/onnxruntime that referenced this pull request Dec 4, 2025
…the TensorRT-RTX Execution Provider to support custom transformer plugins (microsoft#26558)

External TensorRT plugins for transformer models were previously only
available as internal TensorRT components. To enable flexible deployment
these plugins have been externalized into a separate library.
Sumit2318 pushed a commit that referenced this pull request Jan 6, 2026
…the TensorRT-RTX Execution Provider to support custom transformer plugins (#26558)

External TensorRT plugins for transformer models were previously only
available as internal TensorRT components. To enable flexible deployment
these plugins have been externalized into a separate library.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants