Skip to content

[Build] Fix cuda plugin linux build errors - #31616

Merged
tianleiwu merged 1 commit into
mainfrom
tlwu/20260803/fix_linux_cuda_plugin_build
Aug 4, 2026
Merged

[Build] Fix cuda plugin linux build errors#31616
tianleiwu merged 1 commit into
mainfrom
tlwu/20260803/fix_linux_cuda_plugin_build

Conversation

@tianleiwu

@tianleiwu tianleiwu commented Aug 4, 2026

Copy link
Copy Markdown
Contributor

Fix build errors in aarch64:

/onnxruntime_src/include/onnxruntime/core/framework/float4.h: In member function ‘std::pair<float, float> onnxruntime::Float4E2M1x2::ToFloat2() const’:

/onnxruntime_src/include/onnxruntime/core/framework/float4.h:173:67: note: parameter passing for argument of type ‘std::pair<float, float>’ when C++17 is enabled changed to match C++14 in GCC 10.1

  173 |   inline ORT_HOST_DEVICE std::pair<float, float> ToFloat2() const {

      |                                                                   ^

There is another build error in sm120 that data type shall be void* instead of Stream* for cuda plugin.
Change Stream to auto, also add sm120 to CI pipeline to avoid similar error in the future.

@tianleiwu
tianleiwu merged commit 5ea5e69 into main Aug 4, 2026
87 of 89 checks passed
@tianleiwu
tianleiwu deleted the tlwu/20260803/fix_linux_cuda_plugin_build branch August 4, 2026 03:58
tianleiwu added a commit that referenced this pull request Aug 4, 2026
#31616 adds more cuda arch,
but did not reduce nvcc_threads. That might cause out of memory.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants