Clean up Phase 2 workflows (2020, 11_2_X)

[kpedro88]

PR description:

Pursuant to #30512:

Remove outdated subdetectors:

• Tracker: T5, T6, T14, T16
• HGCal: C4, C6, C8
• Muon: M2, M3
• MTD: I5, I7, I9
• Common: O2, O3

Remove corresponding detector versions & workflows: D35, D41, D43, D44, D45, D46, D48

Replace some detector versions: D47 → D60 (keep C10, M3,F3 → M4,F4), D55 → D61 (keep M5, T19 → T17)

Remove unneeded eras: Phase2C4, Phase2C6, Phase2C8, phase2_trackerV14 (& corresponding dd4hep versions)

Currently, workflow numbers are preserved, to ensure consistency between 11_1_X and 11_2_X. The workflow number reset will be targeted for 12_0_X.

A subsequent PR (on top of this one) will try to consolidate HGCal eras.

Fascinatingly, this PR arrives exactly one year after the last cleanup in #27449 (and also contains a very similar amount of additions and deletions.)

PR validation:

Successfully ran workflows 23234.1001, 23234.103, 28234.0.

[cmsbuild]

The code-checks are being triggered in jenkins.

[kpedro88]

please test

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-30645/16920

• This PR adds an extra 96KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File Configuration/Geometry/python/dict2026Geometry.py modified in PR(s): update the tracking material for Phase2 geometry D49 #30126
  • File Geometry/CMSCommonData/python/cmsExtendedGeometry2026D45XML_cfi.py modified in PR(s): update the tracking material for Phase2 geometry D49 #30126
  • File Geometry/CMSCommonData/python/cmsExtendedGeometry2026D46XML_cfi.py modified in PR(s): update the tracking material for Phase2 geometry D49 #30126
  • File L1Trigger/Configuration/python/SimL1Emulator_cff.py modified in PR(s): Phase2 L1 NN Tau #30505

[cmsbuild]

The tests are being triggered in jenkins.

• CMSSW_11_2_X_2020-07-10-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/7875/console Started: 2020/07/11 01:01

[cmsbuild]

A new Pull Request was created by @kpedro88 (Kevin Pedro) for master.

It involves the following packages:

Configuration/Eras
Configuration/Geometry
Configuration/PyReleaseValidation
Configuration/StandardSequences
Geometry/CMSCommonData
L1Trigger/Configuration

@pgunnell, @benkrikler, @Dr15Jones, @makortel, @chayanit, @cvuosalo, @wajidalikhan, @ianna, @mdhildreth, @cmsbuild, @rekovic, @franzoni, @silviodonato, @kpedro88, @civanch, @fabiocos, @davidlange6 can you please review it and eventually sign? Thanks.
@fabiocos, @vargasa, @makortel, @felicepantaleo, @GiacomoSguazzoni, @rovere, @VinInn, @Martin-Grunewald, @lecriste, @mtosi, @dgulhan, @slomeo this is something you requested to watch as well.
@silviodonato, @dpiparo you are the release manager for this.

cms-bot commands are listed here

[mmusich]

As D41 is removed, I think this unit test https://github.com/cms-sw/cmssw/blob/master/SLHCUpgradeSimulations/Geometry/test/phase2_digi_reco_pixelntuple.sh#L6 is going to fail. I suppose it could be migrated to use D49 (T15).

[kpedro88]

@mmusich thanks for pointing out the unit test. I have fixed it now. (Most files in test/ directories are not actually tested or maintained...)

[cmsbuild]

+1
Tested at: a5e4e40
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-bc1051/7875/summary.html
CMSSW: CMSSW_11_2_X_2020-07-10-1100
SCRAM_ARCH: slc7_amd64_gcc820

[cmsbuild]

Comparison job queued.

[cmsbuild]

+1
Tested at: edac4e6
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-bc1051/7878/summary.html
CMSSW: CMSSW_11_2_X_2020-07-10-1100
SCRAM_ARCH: slc7_amd64_gcc820

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-bc1051/7875/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

• /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bc1051/28234.0_TTbar_14TeV+TTbar_14TeV_TuneCP5_2026D60_GenSimHLBeamSpotFull14+DigiFullTrigger_2026D60+RecoFullGlobal_2026D60+HARVESTFullGlobal_2026D60

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 34
• DQMHistoTests: Total histograms compared: 2525996
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2525948
• DQMHistoTests: Total skipped: 47
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
• Checked 142 log files, 17 edm output root files, 34 DQM output files

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-bc1051/7878/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

• /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bc1051/28234.0_TTbar_14TeV+TTbar_14TeV_TuneCP5_2026D60_GenSimHLBeamSpotFull14+DigiFullTrigger_2026D60+RecoFullGlobal_2026D60+HARVESTFullGlobal_2026D60

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 34
• DQMHistoTests: Total histograms compared: 2525996
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2525948
• DQMHistoTests: Total skipped: 47
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
• Checked 142 log files, 17 edm output root files, 34 DQM output files

[kpedro88]

+upgrade

[chayanit]

+1

[cvuosalo]

+1

[kpedro88]

@rekovic @silviodonato please check and sign

[silviodonato]

merge