Add ECAL-only local reconstruction workflow

[fwyzard]

PR description:

Implement:

• ECAL-only RAW-to-DIGI task and sequence
• ECAL-only (no PF) reconsruction task and sequence
• ECAL-only (no PF) offline DQM sequences
• ECAL-only validation sequences

Add two new runTheMatrix.py modifiers:

• .511 for ECAL-only reconstruction
• .512 for ECAL-only reconstruction with GPU modifier

PR validation:

$ runTheMatrix.py -j4 -l 10824.511,10824.512

...

10824.511_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFullPatatrack_ECALOnlyCPU_2018+HARVESTFullPatatrack_ECALOnlyCPU_2018 Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED - time date Mon May 4 13:01:40 2020-date Mon May 4 12:56:37 2020; exit: 0 0 0 0
10824.512_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFullPatatrack_ECALOnlyGPU_2018+HARVESTFullPatatrack_ECALOnlyGPU_2018 Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED - time date Mon May 4 13:01:40 2020-date Mon May 4 12:56:37 2020; exit: 0 0 0 0
2 2 2 2 tests passed, 0 0 0 0 failed

[cmsbuild]

The code-checks are being triggered in jenkins.

[fwyzard]

@cmsbuild, please test

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-29620/14969

• This PR adds an extra 44KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): Add Phase 2 Outer Tracker with sensors updates + OTST MB update. Remove T18. #29607
  • File Configuration/StandardSequences/python/RawToDigi_cff.py modified in PR(s): Squash all Patatrack developments on top of CMSSW_11_3_0_pre5 #27983
  • File Configuration/StandardSequences/python/Reconstruction_cff.py modified in PR(s): Squash all Patatrack developments on top of CMSSW_11_3_0_pre5 #27983
  • File DQMOffline/Configuration/python/DQMOffline_cff.py modified in PR(s): Squash all Patatrack developments on top of CMSSW_11_3_0_pre5 #27983

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/5962/console Started: 2020/05/02 22:30

[cmsbuild]

A new Pull Request was created by @fwyzard (Andrea Bocci) for master.

It involves the following packages:

Configuration/PyReleaseValidation
Configuration/StandardSequences
DQMOffline/Configuration
DQMOffline/Ecal
Validation/Configuration

@pgunnell, @andrius-k, @silviodonato, @chayanit, @wajidalikhan, @schneiml, @civanch, @mdhildreth, @cmsbuild, @kmaeshima, @franzoni, @jfernan2, @fioriNTU, @fabiocos, @kpedro88, @davidlange6 can you please review it and eventually sign? Thanks.
@fabiocos, @makortel, @felicepantaleo, @GiacomoSguazzoni, @rovere, @VinInn, @Martin-Grunewald, @apsallid, @lecriste, @argiro, @threus, @dgulhan, @rociovilar this is something you requested to watch as well.
@silviodonato, @dpiparo you are the release manager for this.

cms-bot commands are listed here

[cmsbuild]

+1
Tested at: cd8f431
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-626513/5962/summary.html
CMSSW: CMSSW_11_1_X_2020-05-02-1100
SCRAM_ARCH: slc7_amd64_gcc820

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-626513/5962/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 34
• DQMHistoTests: Total histograms compared: 2696239
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2695919
• DQMHistoTests: Total skipped: 319
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
• Checked 147 log files, 16 edm output root files, 34 DQM output files

[jfernan2]

+1
Thanks for this example!

[civanch]

+1

[chayanit]

+1

[silviodonato]

+operations

[kpedro88]

+upgrade

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo (and backports should be raised in the release meeting by the corresponding L2)

[silviodonato]

+1

[fwyzard]

In the meantime, following some suggestions from @missirol, I've prepared a configuration that adds PF rechits, PF clusters, and HLT-like PF superclusters.

I'm using an HLT-like configuration because the Offline configuration requires the primary vertices, and thus full tracking, etc., which is not really "ECAL-only" any more.

[fwyzard]

See #29635.