Run3-Trk07 Take care of unit test failure in SimTracker/TrackerMaterialAnalysis #34596

bsunanda · 2021-07-22T17:36:09Z

PR description:

Take care of unit test failure in SimTracker/TrackerMaterialAnalysis

PR validation:

Ran the scripts in the test area

if this PR is a backport please specify the original PR and why you need to backport that PR:

Nothing special

cmsbuild · 2021-07-22T17:43:24Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-34596/24153

This PR adds an extra 12KB to repository

cmsbuild · 2021-07-22T17:43:44Z

A new Pull Request was created by @bsunanda (Sunanda Banerjee) for master.

It involves the following packages:

SimTracker/TrackerMaterialAnalysis (simulation)

@cmsbuild, @civanch, @mdhildreth can you please review it and eventually sign? Thanks.
@vargasa, @makortel, @mtosi, @GiacomoSguazzoni, @JanFSchulte, @rovere, @VinInn, @apsallid, @mmusich, @threus, @dgulhan this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy, @perrotta you are the release manager for this.

cms-bot commands are listed here

bsunanda · 2021-07-22T17:45:35Z

@cmsbuild Please test

cmsbuild · 2021-07-22T19:20:35Z

-1

Failed Tests: RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-64c456/17106/summary.html
COMMIT: d0fb432
CMSSW: CMSSW_12_0_X_2021-07-22-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34596/17106/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

11634.911

----- Begin Fatal Exception 22-Jul-2021 20:14:17 CEST-----------------------
An exception of category 'StdException' occurred while
   [0] Running EventSetup component DDDetectorESProducer/'
Exception Message:
A std::exception was thrown.
An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file Geometry/VeryForwardData/data/RP_Vertical_Device/2021/v1/RP_Vertical_Device.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34596/17106/CMSSW_12_0_X_2021-07-22-1100/poison:/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34596/17106/CMSSW_12_0_X_2021-07-22-1100/src:/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34596/17106/CMSSW_12_0_X_2021-07-22-1100/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week0/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-07-22-1100/src:/cvmfs/cms-ib.cern.ch/week0/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-07-22-1100/external/slc7_amd64_gcc900/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/runTheMatrix-results/11634.911_TTbar_14TeV+2021_DD4hep+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST+ALCA

dd4hep: Error interpreting XML nodes of type <Include/>
dd4hep: Error interpreting XML nodes of type <IncludeSection/>
dd4hep: while parsing /cvmfs/cms-ib.cern.ch/nweek-02690/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-07-22-1100/src/Geometry/CMSCommonData/data/dd4hep/cmsExtendedGeometry2021.xml
dd4hep: with plugin:DD4hep_CompactLoader
----- End Fatal Exception -------------------------------------------------

bsunanda · 2021-07-22T20:44:23Z

@qliphy @silviodonato Please do the test once the issue of PPS xml files is resolved

perrotta · 2021-07-22T21:10:30Z

please test

cmsbuild · 2021-07-22T23:00:27Z

-1

Failed Tests: RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-64c456/17115/summary.html
COMMIT: d0fb432
CMSSW: CMSSW_12_0_X_2021-07-22-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34596/17115/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

11634.911

----- Begin Fatal Exception 22-Jul-2021 23:54:50 CEST-----------------------
An exception of category 'StdException' occurred while
   [0] Running EventSetup component DDDetectorESProducer/'
Exception Message:
A std::exception was thrown.
An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file Geometry/VeryForwardData/data/RP_Vertical_Device/2021/v1/RP_Vertical_Device.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34596/17115/CMSSW_12_0_X_2021-07-22-1100/poison:/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34596/17115/CMSSW_12_0_X_2021-07-22-1100/src:/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34596/17115/CMSSW_12_0_X_2021-07-22-1100/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week0/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-07-22-1100/src:/cvmfs/cms-ib.cern.ch/week0/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-07-22-1100/external/slc7_amd64_gcc900/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/runTheMatrix-results/11634.911_TTbar_14TeV+2021_DD4hep+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST+ALCA

dd4hep: Error interpreting XML nodes of type <Include/>
dd4hep: Error interpreting XML nodes of type <IncludeSection/>
dd4hep: while parsing /cvmfs/cms-ib.cern.ch/nweek-02690/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-07-22-1100/src/Geometry/CMSCommonData/data/dd4hep/cmsExtendedGeometry2021.xml
dd4hep: with plugin:DD4hep_CompactLoader
----- End Fatal Exception -------------------------------------------------

bsunanda · 2021-07-23T01:04:17Z

@cmsbuild Please test

mmusich · 2021-07-23T06:00:00Z

SimTracker/TrackerMaterialAnalysis/test/trackingMaterialProducer10GeVNeutrino_ForPhaseII.py

@@ -52,7 +52,7 @@
   from Configuration.AlCa.GlobalTag import GlobalTag
   process.GlobalTag = GlobalTag(process.GlobalTag, 'auto:phase2_realistic', '')
 else:
-   process.load('Configuration.Geometry.GeometryExtended2026D49_cff')
+   process.load('Configuration.Geometry.GeometryExtended2026D49Reco_cff')


Why this requires the reco geometry?

The reason is HCAL went through a phase where HE was considered a possibility for Phase2 detector. That needs the grouping at SIM and RECO level to be different. Later Reco regrouping was needed in some SIM related studies. That is why it is always better to include the so called RECO geometry which any way has the SIM geometry inside it.

cmsbuild · 2021-07-23T08:42:20Z

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-64c456/17124/summary.html
COMMIT: d0fb432
CMSSW: CMSSW_12_0_X_2021-07-22-1700/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34596/17124/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

11601.011601.0_SingleElectronPt10+2021+SingleElectronPt10_pythia8_GenSimINPUT+Digi+Reco+HARVEST+ALCA/step2_SingleElectronPt10+2021+SingleElectronPt10_pythia8_GenSimINPUT+Digi+Reco+HARVEST+ALCA.log
11602.011602.0_SingleElectronPt35+2021+SingleElectronPt35_pythia8_GenSimINPUT+Digi+Reco+HARVEST+ALCA/step2_SingleElectronPt35+2021+SingleElectronPt35_pythia8_GenSimINPUT+Digi+Reco+HARVEST+ALCA.log
11603.011603.0_SingleElectronPt1000+2021+SingleElectronPt1000_pythia8_GenSimINPUT+Digi+Reco+HARVEST+ALCA/step2_SingleElectronPt1000+2021+SingleElectronPt1000_pythia8_GenSimINPUT+Digi+Reco+HARVEST+ALCA.log

Expand to see more relval errors ...

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 39
DQMHistoTests: Total histograms compared: 2998564
DQMHistoTests: Total failures: 7
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2998535
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 38 files compared)
Checked 165 log files, 37 edm output root files, 39 DQM output files
TriggerResults: no differences found

bsunanda · 2021-07-23T11:40:02Z

@cmsbuild Please test

cmsbuild · 2021-07-23T14:54:06Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-64c456/17141/summary.html
COMMIT: d0fb432
CMSSW: CMSSW_12_0_X_2021-07-22-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34596/17141/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 39
DQMHistoTests: Total histograms compared: 2998564
DQMHistoTests: Total failures: 1
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2998541
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 38 files compared)
Checked 165 log files, 37 edm output root files, 39 DQM output files
TriggerResults: no differences found

bsunanda · 2021-07-23T15:37:15Z

@cvuosalo @qliphy @perrotta @silviodonato @civanch Kindly approve and integrate this PR on an urgent basis to remove the unit test failure message

cvuosalo · 2021-07-23T15:58:33Z

+geometry

civanch · 2021-07-23T16:02:05Z

+1

cmsbuild · 2021-07-23T16:05:43Z

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy, @perrotta (and backports should be raised in the release meeting by the corresponding L2)

qliphy · 2021-07-23T16:47:54Z

+1

Take care of unit test failure

d0fb432

cmsbuild added this to the CMSSW_12_0_X milestone Jul 22, 2021

cmsbuild added code-checks-pending orp-pending pending-signatures simulation-pending tests-pending labels Jul 22, 2021

bsunanda mentioned this pull request Jul 22, 2021

Unit failure on SimTracker/TrackerMaterialAnalysis #34587

Closed

cmsbuild added code-checks-approved and removed code-checks-pending labels Jul 22, 2021

cmsbuild added tests-started and removed tests-pending labels Jul 22, 2021

cmsbuild added tests-rejected and removed tests-started labels Jul 22, 2021

cmsbuild added tests-started and removed tests-rejected labels Jul 22, 2021

cmsbuild added tests-rejected and removed tests-started labels Jul 22, 2021

cmsbuild added tests-started and removed tests-rejected labels Jul 23, 2021

mmusich reviewed Jul 23, 2021

View reviewed changes

cmsbuild added tests-rejected and removed tests-started labels Jul 23, 2021

cmsbuild added tests-started and removed tests-rejected labels Jul 23, 2021

cmsbuild added tests-approved and removed tests-started labels Jul 23, 2021

cmsbuild added fully-signed simulation-approved and removed pending-signatures simulation-pending labels Jul 23, 2021

cmsbuild added orp-approved and removed orp-pending labels Jul 23, 2021

cmsbuild merged commit e6d2c8f into cms-sw:master Jul 23, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Run3-Trk07 Take care of unit test failure in SimTracker/TrackerMaterialAnalysis #34596

Run3-Trk07 Take care of unit test failure in SimTracker/TrackerMaterialAnalysis #34596

bsunanda commented Jul 22, 2021

cmsbuild commented Jul 22, 2021

cmsbuild commented Jul 22, 2021

bsunanda commented Jul 22, 2021

cmsbuild commented Jul 22, 2021

bsunanda commented Jul 22, 2021

perrotta commented Jul 22, 2021

cmsbuild commented Jul 22, 2021

bsunanda commented Jul 23, 2021

mmusich Jul 23, 2021

bsunanda Jul 23, 2021

cmsbuild commented Jul 23, 2021

bsunanda commented Jul 23, 2021

cmsbuild commented Jul 23, 2021

bsunanda commented Jul 23, 2021

cvuosalo commented Jul 23, 2021

civanch commented Jul 23, 2021

cmsbuild commented Jul 23, 2021

qliphy commented Jul 23, 2021

Run3-Trk07 Take care of unit test failure in SimTracker/TrackerMaterialAnalysis #34596

Run3-Trk07 Take care of unit test failure in SimTracker/TrackerMaterialAnalysis #34596

Conversation

bsunanda commented Jul 22, 2021

PR description:

PR validation:

if this PR is a backport please specify the original PR and why you need to backport that PR:

cmsbuild commented Jul 22, 2021

cmsbuild commented Jul 22, 2021

bsunanda commented Jul 22, 2021

cmsbuild commented Jul 22, 2021

RelVals

bsunanda commented Jul 22, 2021

perrotta commented Jul 22, 2021

cmsbuild commented Jul 22, 2021

RelVals

bsunanda commented Jul 23, 2021

mmusich Jul 23, 2021

Choose a reason for hiding this comment

bsunanda Jul 23, 2021

Choose a reason for hiding this comment

cmsbuild commented Jul 23, 2021

RelVals-INPUT

Comparison Summary

bsunanda commented Jul 23, 2021

cmsbuild commented Jul 23, 2021

Comparison Summary

bsunanda commented Jul 23, 2021

cvuosalo commented Jul 23, 2021

civanch commented Jul 23, 2021

cmsbuild commented Jul 23, 2021

qliphy commented Jul 23, 2021