Update onnxruntime to 1.14.1 #8397

iarspider · 2023-03-20T13:48:55Z

No description provided.

iarspider · 2023-03-20T13:49:03Z

please test

cmsbuild · 2023-03-20T13:49:21Z

A new Pull Request was created by @iarspider for branch IB/CMSSW_13_1_X/master.

@smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2023-03-20T15:00:32Z

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31445/summary.html
COMMIT: 8f5b9b5
CMSSW: CMSSW_13_1_X_2023-03-19-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8397/31445/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@cms-sw [jemalloc] move common sections in to jemalloc-common #8393

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31445/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31445/git-merge-result

Build

I found compilation error when building:

>> Leaving Package PhysicsTools/ONNXRuntime
>> Package PhysicsTools/ONNXRuntime built
Entering library rule at PhysicsTools/ONNXRuntime
>> Compiling  /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-19-2300/src/PhysicsTools/ONNXRuntime/src/ONNXRuntime.cc
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-19-2300/src/PhysicsTools/ONNXRuntime/src/ONNXRuntime.cc: In constructor 'cms::Ort::ONNXRuntime::ONNXRuntime(const string&, const Ort::SessionOptions*)':
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-19-2300/src/PhysicsTools/ONNXRuntime/src/ONNXRuntime.cc:42:40: error: 'struct Ort::Session' has no member named 'GetInputName'
   42 |       std::string input_name(session_->GetInputName(i, allocator));
      |                                        ^~~~~~~~~~~~
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-19-2300/src/PhysicsTools/ONNXRuntime/src/ONNXRuntime.cc:51:32: warning: 'void Ort::detail::TensorTypeAndShapeInfoImpl::GetDimensions(int64_t*, size_t) const [with T = Ort::detail::Unowned; int64_t = long int; size_t = long unsigned int]' is deprecated: use GetShape() [-Wdeprecated-declarations]
   51 |       tensor_info.GetDimensions(input_node_dims_[input_name].data(), num_dims);
      |       ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

iarspider · 2023-03-21T13:19:08Z

please test with cms-sw/cmssw#41118

cmsbuild · 2023-03-21T14:19:20Z

-1

Failed Tests: Build ClangBuild
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31477/summary.html
COMMIT: 8f5b9b5
CMSSW: CMSSW_13_1_X_2023-03-21-0700/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8397/31477/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31477/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31477/git-merge-result

Build

I found compilation error when building:

>> Leaving Package PhysicsTools/ONNXRuntime
>> Package PhysicsTools/ONNXRuntime built
Entering library rule at PhysicsTools/ONNXRuntime
>> Compiling  /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-0700/src/PhysicsTools/ONNXRuntime/src/ONNXRuntime.cc
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-0700/src/PhysicsTools/ONNXRuntime/src/ONNXRuntime.cc: In constructor 'cms::Ort::ONNXRuntime::ONNXRuntime(const string&, const Ort::SessionOptions*)':
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-0700/src/PhysicsTools/ONNXRuntime/src/ONNXRuntime.cc:42:75: error: no matching function for call to 'std::__cxx11::basic_string::basic_string(Ort::AllocatedStringPtr)'
   42 |       std::string input_name(session_->GetInputNameAllocated(i, allocator));
      |                                                                           ^
In file included from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc11/external/gcc/11.2.1-f9b9dfdd886f71cd63f5538223d8f161/include/c++/11.2.1/string:55,
                 from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-0700/src/PhysicsTools/ONNXRuntime/interface/ONNXRuntime.h:16,
                 from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-0700/src/PhysicsTools/ONNXRuntime/src/ONNXRuntime.cc:8:

Clang Build

I found compilation error while trying to compile with clang. Command used:

USER_CUDA_FLAGS='--expt-relaxed-constexpr' USER_CXXFLAGS='-Wno-register -fsyntax-only' scram build -k -j 32 COMPILER='llvm compile'

>> Entering Package RecoParticleFlow/PFProducer
>> Entering Package RecoParticleFlow/PFSimProducer
>> Entering Package SimTracker/TrackTriggerAssociation
>> Entering Package Validation/SiOuterTrackerV
>> Compile sequence completed for CMSSW CMSSW_13_1_X_2023-03-21-0700
gmake: *** [There are compilation/build errors. Please see the detail log above.] Error 1
+ eval scram build outputlog '&&' '(python3' /data/cmsbld/jenkins/workspace/ib-run-pr-tests/cms-bot/buildLogAnalyzer.py --logDir /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-0700/tmp/el8_amd64_gcc11/cache/log/src '||' 'true)'
++ scram build outputlog
>> Entering Package DQMOffline/Trigger
Entering library rule at src/DQMOffline/Trigger/plugins
>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-0700/src/DQMOffline/Trigger/plugins/BPHMonitor.cc

iarspider · 2023-03-21T14:52:41Z

please test with cms-sw/cmssw#41118

cmsbuild · 2023-03-21T15:43:16Z

-1

Failed Tests: Build ClangBuild
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31480/summary.html
COMMIT: 8f5b9b5
CMSSW: CMSSW_13_1_X_2023-03-21-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8397/31480/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@perrotta Reduce non necessary sqrt computations in RecoTauTag/HLTProducers cmssw#41100

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31480/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31480/git-merge-result

Build

I found compilation error when building:

Entering library rule at src/DQM/EcalMonitorClient/plugins
>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-1100/src/DQM/EcalMonitorClient/plugins/EcalDQMonitorClient.cc
>> Building edm plugin tmp/el8_amd64_gcc11/src/DQM/EcalMonitorClient/plugins/DQMEcalMonitorClientPlugins/libDQMEcalMonitorClientPlugins.so
Leaving library rule at src/DQM/EcalMonitorClient/plugins
@@@@ Running edmWriteConfigs for DQMEcalMonitorClientPlugins
error: edmWriteConfigs caught an exception while loading a plugin library.
The executable will return success (0) so scram will continue,
but no cfi files will be written.
An exception of category 'PluginLibraryLoadError' occurred.
Exception Message:
unable to load /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-1100/tmp/el8_amd64_gcc11/src/DQM/EcalMonitorClient/plugins/DQMEcalMonitorClientPlugins/libDQMEcalMonitorClientPlugins.so because libonnxruntime.so.1.10.0: cannot open shared object file: No such file or directory

Clang Build

I found compilation error while trying to compile with clang. Command used:

USER_CUDA_FLAGS='--expt-relaxed-constexpr' USER_CXXFLAGS='-Wno-register -fsyntax-only' scram build -k -j 32 COMPILER='llvm compile'

>> Entering Package RecoParticleFlow/PFProducer
>> Entering Package RecoParticleFlow/PFSimProducer
>> Entering Package SimTracker/TrackTriggerAssociation
>> Entering Package Validation/SiOuterTrackerV
>> Compile sequence completed for CMSSW CMSSW_13_1_X_2023-03-21-1100
gmake: *** [There are compilation/build errors. Please see the detail log above.] Error 1
+ eval scram build outputlog '&&' '(python3' /data/cmsbld/jenkins/workspace/ib-run-pr-tests/cms-bot/buildLogAnalyzer.py --logDir /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-1100/tmp/el8_amd64_gcc11/cache/log/src '||' 'true)'
++ scram build outputlog
>> Entering Package RecoTauTag/HLTProducers
Entering library rule at RecoTauTag/HLTProducers
>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-1100/src/RecoTauTag/HLTProducers/src/CaloTowerFromL1TCreatorForTauHLT.cc

smuzaffar · 2023-03-21T15:46:49Z

test parameters:

pull_request = Update to new ONNXRuntime api cmssw#41118

smuzaffar · 2023-03-21T15:47:25Z

please test

cmsbuild · 2023-03-21T16:39:49Z

-1

Failed Tests: Build ClangBuild
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31488/summary.html
COMMIT: 8f5b9b5
CMSSW: CMSSW_13_1_X_2023-03-21-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8397/31488/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31488/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31488/git-merge-result

Build

I found compilation error when building:

Entering library rule at src/DQM/EcalMonitorClient/plugins
>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-1100/src/DQM/EcalMonitorClient/plugins/EcalDQMonitorClient.cc
>> Building edm plugin tmp/el8_amd64_gcc11/src/DQM/EcalMonitorClient/plugins/DQMEcalMonitorClientPlugins/libDQMEcalMonitorClientPlugins.so
Leaving library rule at src/DQM/EcalMonitorClient/plugins
@@@@ Running edmWriteConfigs for DQMEcalMonitorClientPlugins
error: edmWriteConfigs caught an exception while loading a plugin library.
The executable will return success (0) so scram will continue,
but no cfi files will be written.
An exception of category 'PluginLibraryLoadError' occurred.
Exception Message:
unable to load /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-1100/tmp/el8_amd64_gcc11/src/DQM/EcalMonitorClient/plugins/DQMEcalMonitorClientPlugins/libDQMEcalMonitorClientPlugins.so because libonnxruntime.so.1.10.0: cannot open shared object file: No such file or directory

Clang Build

I found compilation error while trying to compile with clang. Command used:

USER_CUDA_FLAGS='--expt-relaxed-constexpr' USER_CXXFLAGS='-Wno-register -fsyntax-only' scram build -k -j 32 COMPILER='llvm compile'

>> Entering Package RecoParticleFlow/PFProducer
>> Entering Package RecoParticleFlow/PFSimProducer
>> Entering Package SimTracker/TrackTriggerAssociation
>> Entering Package Validation/SiOuterTrackerV
>> Compile sequence completed for CMSSW CMSSW_13_1_X_2023-03-21-1100
gmake: *** [There are compilation/build errors. Please see the detail log above.] Error 1
+ eval scram build outputlog '&&' '(python3' /data/cmsbld/jenkins/workspace/ib-run-pr-tests/cms-bot/buildLogAnalyzer.py --logDir /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-1100/tmp/el8_amd64_gcc11/cache/log/src '||' 'true)'
++ scram build outputlog
>> Entering Package HLTrigger/JetMET
Entering library rule at src/HLTrigger/JetMET/plugins
>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_1_X_2023-03-21-1100/src/HLTrigger/JetMET/plugins/HLTJetTimingFilter.cc

cmsbuild · 2023-04-05T20:18:03Z

Pull request #8397 was updated.

smuzaffar · 2023-04-05T20:18:39Z

please test

cmsbuild · 2023-04-06T18:19:08Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31862/summary.html
COMMIT: 8acc5b8
CMSSW: CMSSW_13_1_X_2023-04-05-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8397/31862/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31862/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31862/git-merge-result

Comparison Summary

Summary:

You potentially added 24 lines to the logs
Reco comparison results: 7 differences found in the comparisons
DQMHistoTests: Total files compared: 47
DQMHistoTests: Total histograms compared: 3365163
DQMHistoTests: Total failures: 4
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3365137
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 46 files compared)
Checked 202 log files, 155 edm output root files, 47 DQM output files
TriggerResults: no differences found

smuzaffar · 2023-04-07T15:24:57Z

please test

cmsbuild · 2023-04-08T01:44:09Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31888/summary.html
COMMIT: 8acc5b8
CMSSW: CMSSW_13_1_X_2023-04-07-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8397/31888/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31888/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33a70b/31888/git-merge-result

Comparison Summary

Summary:

You potentially removed 5 lines from the logs
Reco comparison results: 15 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3459609
DQMHistoTests: Total failures: 9
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3459578
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 207 log files, 159 edm output root files, 48 DQM output files
TriggerResults: no differences found

rappoccio · 2023-04-10T13:55:35Z

+1

rappoccio · 2023-04-10T13:56:28Z

@smuzaffar once you are happy with this I will merge the accompanying PR (cms-sw/cmssw#41118)

smuzaffar · 2023-04-10T14:46:46Z

@rappoccio , I am happy with this update. please go ahead and merge both PRs.

rappoccio · 2023-04-10T19:55:00Z

please merge

perrotta · 2023-04-10T20:42:11Z

merge

smuzaffar · 2023-04-10T20:53:56Z

+externals

cmsbuild · 2023-04-10T20:54:18Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_13_1_X/master IBs (tests are also fine). This pull request will be automatically merged.

Update onnxruntime to 1.14.1

8f5b9b5

cmsbuild added externals-pending pending-signatures tests-started orp-pending labels Mar 20, 2023

cmsbuild added tests-rejected and removed tests-started labels Mar 20, 2023

smuzaffar mentioned this pull request Mar 21, 2023

Update gcc 12 builds to CUDA 12.1 #8296

Merged

iarspider mentioned this pull request Mar 21, 2023

Update to new ONNXRuntime api cms-sw/cmssw#41118

Merged

cmsbuild added requires-external tests-started tests-rejected and removed tests-rejected tests-started labels Mar 21, 2023

cmsbuild added tests-started and removed tests-rejected labels Mar 21, 2023

cmsbuild added tests-rejected and removed tests-started labels Mar 21, 2023

cmsbuild added tests-started and removed tests-rejected labels Mar 21, 2023

cmsbuild added tests-started and removed tests-pending labels Apr 5, 2023

cmsbuild added tests-approved and removed tests-started labels Apr 6, 2023

cmsbuild added tests-started and removed tests-approved labels Apr 7, 2023

cmsbuild added tests-approved and removed tests-started labels Apr 8, 2023

cmsbuild added orp-approved and removed orp-pending labels Apr 10, 2023

cmsbuild merged commit 97e5c60 into IB/CMSSW_13_1_X/master Apr 10, 2023
11 checks passed

cmsbuild added externals-approved fully-signed and removed externals-pending pending-signatures labels Apr 10, 2023

perrotta deleted the onnxruntime-1.14.1 branch April 10, 2023 20:55

cmsbuild mentioned this pull request Apr 11, 2023

Update Tensorflow to version 2.11.0 #8258

Closed

abhih1 mentioned this pull request Apr 27, 2023

Adding the Ecal Endcaps to the ML based online ECAL DQM [13_0_X] cms-sw/cmssw#41195

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update onnxruntime to 1.14.1 #8397

Update onnxruntime to 1.14.1 #8397

iarspider commented Mar 20, 2023

iarspider commented Mar 20, 2023

cmsbuild commented Mar 20, 2023

cmsbuild commented Mar 20, 2023

iarspider commented Mar 21, 2023

cmsbuild commented Mar 21, 2023

iarspider commented Mar 21, 2023

cmsbuild commented Mar 21, 2023

smuzaffar commented Mar 21, 2023 •

edited

smuzaffar commented Mar 21, 2023

cmsbuild commented Mar 21, 2023

cmsbuild commented Apr 5, 2023

smuzaffar commented Apr 5, 2023

cmsbuild commented Apr 6, 2023

smuzaffar commented Apr 7, 2023

cmsbuild commented Apr 8, 2023

rappoccio commented Apr 10, 2023

rappoccio commented Apr 10, 2023

smuzaffar commented Apr 10, 2023 •

edited

rappoccio commented Apr 10, 2023

perrotta commented Apr 10, 2023

smuzaffar commented Apr 10, 2023

cmsbuild commented Apr 10, 2023

Update onnxruntime to 1.14.1 #8397

Update onnxruntime to 1.14.1 #8397

Conversation

iarspider commented Mar 20, 2023

iarspider commented Mar 20, 2023

cmsbuild commented Mar 20, 2023

cmsbuild commented Mar 20, 2023

Build

iarspider commented Mar 21, 2023

cmsbuild commented Mar 21, 2023

Build

Clang Build

iarspider commented Mar 21, 2023

cmsbuild commented Mar 21, 2023

Build

Clang Build

smuzaffar commented Mar 21, 2023 • edited

smuzaffar commented Mar 21, 2023

cmsbuild commented Mar 21, 2023

Build

Clang Build

cmsbuild commented Apr 5, 2023

smuzaffar commented Apr 5, 2023

cmsbuild commented Apr 6, 2023

Comparison Summary

smuzaffar commented Apr 7, 2023

cmsbuild commented Apr 8, 2023

Comparison Summary

rappoccio commented Apr 10, 2023

rappoccio commented Apr 10, 2023

smuzaffar commented Apr 10, 2023 • edited

rappoccio commented Apr 10, 2023

perrotta commented Apr 10, 2023

smuzaffar commented Apr 10, 2023

cmsbuild commented Apr 10, 2023

smuzaffar commented Mar 21, 2023 •

edited

smuzaffar commented Apr 10, 2023 •

edited