Include final 2021 MC DD4HEP geometry tags + new 2021 design MC beamspot GT

[tvami]

PR description:

DD4HEP change

Include final 2021 MC DD4HEP geometry tags using the new autoCond modifier method. The new tags are explicitly visible in the code change, but for completeness they include

tag: XMLFILE_Geometry_121DD4hepV1_Extended2021_mc 
label: Extended

and

tag: TKRECO_Geometry_121DD4hepV1

as requested in [1]

[1] https://hypernews.cern.ch/HyperNews/CMS/get/calibrations/4475.html

New 2021 design MC beamspot GT

The second part of this PR is to include a new record introduced in [2] in the 2021 design MC as it was realized earlier that it was not created, see the comment [3]. The HN request can be found under [4].

The new GT and the diff wrt to the prev versioned GT are

• 121X_mcRun3_2021_design_v8
  https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/121X_mcRun3_2021_design_v7/121X_mcRun3_2021_design_v8

They differ only in the requested tags:

  | BeamSpotOnlineHLTObjectsRcd | - | - | BeamSpotOnlineObjects_Ideal_Centered_SLHC_v3_mc
  | BeamSpotOnlineLegacyObjectsRcd | - | - | BeamSpotOnlineObjects_Ideal_Centered_SLHC_v3_mc

[2] #35373
[3] #35478 (comment)
[4] https://hypernews.cern.ch/HyperNews/CMS/get/calibrations/4474/3.html

if this PR is a backport please specify the original PR and why you need to backport that PR:

This is not a backport but a backport to 12_0_X for the beamspot part is expected.

cc: @cms-sw/geometry-l2 @srimanob

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-35514/25720

• This PR adds an extra 12KB to repository

[cmsbuild]

A new Pull Request was created by @tvami (Tamas Vami) for master.

It involves the following packages:

• Configuration/AlCa (alca)

@yuanchao, @malbouis, @cmsbuild, @tvami, @francescobrivio can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @missirol, @mmusich, @fabiocos, @tocheng this is something you requested to watch as well.
@perrotta, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

[tvami]

test parameters:

• workflows = 12034.0,11634.912

[tvami]

@cmsbuild , please test

[cmsbuild]

-1

Failed Tests: RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-aefadd/19345/summary.html
COMMIT: da7a5c0
CMSSW: CMSSW_12_1_X_2021-10-02-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/35514/19345/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

• 11634.912

----- Begin Fatal Exception 03-Oct-2021 03:09:50 CEST-----------------------
An exception of category 'TrackingTools/PatternTools' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 9 stream: 0
   [1] Running path 'HLT_TrkMu6NoFiltersNoVtx_v1'
   [2] Calling method for module CkfTrackCandidateMaker/'hltIterL3OITrackCandidatesNoVtx'
Exception Message:
Trajectory::check() - information requested from empty Trajectory 
----- End Fatal Exception -------------------------------------------------

[tvami]

-1

Failed Tests: RelVals Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-aefadd/19345/summary.html COMMIT: da7a5c0 CMSSW: CMSSW_12_1_X_2021-10-02-1100/slc7_amd64_gcc900 User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/35514/19345/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

• 11634.912

----- Begin Fatal Exception 03-Oct-2021 03:09:50 CEST-----------------------
An exception of category 'TrackingTools/PatternTools' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 9 stream: 0
   [1] Running path 'HLT_TrkMu6NoFiltersNoVtx_v1'
   [2] Calling method for module CkfTrackCandidateMaker/'hltIterL3OITrackCandidatesNoVtx'
Exception Message:
Trajectory::check() - information requested from empty Trajectory 
----- End Fatal Exception -------------------------------------------------

Interesting, this ran fine for 9 events, and only broke for the 10th event. @cvuosalo have you seen anything like this while locally testing these tags? Did I miss something in the autoCondModifier?

[srimanob]

@cmsbuild please test

Give it another try. If we somehow have a random issue, we will see it also in the production test of dd4hep.

[cmsbuild]

-1

Failed Tests: RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-aefadd/19346/summary.html
COMMIT: da7a5c0
CMSSW: CMSSW_12_1_X_2021-10-02-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/35514/19346/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

• 11634.912

----- Begin Fatal Exception 03-Oct-2021 05:50:47 CEST-----------------------
An exception of category 'TrackingTools/PatternTools' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 9 stream: 0
   [1] Running path 'HLT_TrkMu6NoFiltersNoVtx_v1'
   [2] Calling method for module CkfTrackCandidateMaker/'hltIterL3OITrackCandidatesNoVtx'
Exception Message:
Trajectory::check() - information requested from empty Trajectory 
----- End Fatal Exception -------------------------------------------------

[mmusich]

@tvami @srimanob looks like you need to test with #35493

[srimanob]

@cmsbuild please test with #35493

[qliphy]

urgent
for 12_1_0_pre4,
see https://its.cern.ch/jira/browse/PDMVRELVALS-134

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-aefadd/19347/summary.html
COMMIT: da7a5c0
CMSSW: CMSSW_12_1_X_2021-10-02-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/35514/19347/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

• /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-aefadd/12034.0_TTbar_14TeV+2021Design+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST

Summary:

• No significant changes to the logs found
• Reco comparison results: 3085 differences found in the comparisons
• DQMHistoTests: Total files compared: 40
• DQMHistoTests: Total histograms compared: 3219394
• DQMHistoTests: Total failures: 6702
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3212670
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 39 files compared)
• Checked 169 log files, 37 edm output root files, 40 DQM output files
• TriggerResults: found differences in 1 / 39 workflows

[tvami]

Results are as expected:

• changes only in 11634.912 and there we see changes everywhere which is expected due to the geometry change

[francescobrivio]

+alca

• see comment in Include final 2021 MC DD4HEP geometry tags + new 2021 design MC beamspot GT #35514 (comment)

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

[perrotta]

+1