Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

migrate from run2_miniAOD_devel to run2_miniAOD_UL for miniAOD setup UL workflows #31072

Conversation

slava77
Copy link
Contributor

@slava77 slava77 commented Aug 6, 2020

This PR switches from a generic run2_miniAOD_devel modifier to the run2 UL re-miniAOD target run2_miniAOD_UL.

Additionally, RecoEgamma/EgammaTools/python/egammaObjectModificationsInMiniAOD_cff.py now enables the electron/photon scales and smearing (something missed in #30199)

Tests

  • regular setup of re-miniAOD workflows runs and produces differences in expected places compared to the baseline (which is equivalent to the original UL miniAOD)
    • This is mostly an integration test with a bit conceptual validation; the comparison here was done at a bit earlier step in CMSSW_10_6_X_2020-07-29-2300
  • (non-ideal) identity test is done to compare UL reminiAOD made in CMSSW_11_2_X_2020-07-29-1100 (which has all bugfixes and UL-specific settings enabled with run2_miniAOD_UL) with CMSSW_10_6_X_2020-08-05-1100 + this PR using 112X GT. This test is done only for data wf 136.88811 (reprocessing of 2018).

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 6, 2020

A new Pull Request was created by @slava77 (Slava Krutelyov) for CMSSW_10_6_X.

It involves the following packages:

CommonTools/PileupAlgos
PhysicsTools/PatAlgos
PhysicsTools/PatUtils
RecoCTPPS/ProtonReconstruction
RecoEgamma/EgammaPhotonProducers
RecoEgamma/EgammaTools
RecoJets/JetProducers
RecoMET/METProducers
RecoTauTag/Configuration

@perrotta, @jpata, @cmsbuild, @santocch, @slava77 can you please review it and eventually sign? Thanks.
@emilbols, @gouskos, @yslai, @jainshilpi, @hatakeyamak, @rappoccio, @lgray, @peruzzim, @seemasharmafnal, @mmarionncern, @ahinzmann, @smoortga, @varuns23, @jdolen, @ferencek, @forthommel, @Sam-Harper, @rovere, @jdamgov, @nhanvtran, @gkasieczka, @schoef, @andrzejnovak, @clelange, @riga, @jan-kaspar, @JyothsnaKomaragiri, @mverzett, @sobhatta, @lecriste, @afiqaize, @gpetruc, @mariadalfonso this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

@slava77
Copy link
Contributor Author

slava77 commented Aug 6, 2020

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 6, 2020

The tests are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 6, 2020

+1
Tested at: bd0bca6
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7daf26/8602/summary.html
CMSSW: CMSSW_10_6_X_2020-08-05-2300
SCRAM_ARCH: slc7_amd64_gcc700

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 6, 2020

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 6, 2020

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7daf26/8602/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 491 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 3214618
  • DQMHistoTests: Total failures: 3
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3214281
  • DQMHistoTests: Total skipped: 334
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 140 log files, 14 edm output root files, 34 DQM output files

@slava77
Copy link
Contributor Author

slava77 commented Aug 6, 2020

Reco comparison results: 491 differences found in the comparisons
These are all in the (only) UL re-miniAOD workflow 136.88811, which is still set to effectively do just redo the standard UL miniAOD in the baseline.

Also, in bin-by-bin comparisons we can see

  • the expected increase in the lostTracks in more detail https://tinyurl.com/y49fs2nv (this does not show up in the reco comparisons due to issues with packed candidates format display in plain FWLite by the reco validation script)

@slava77
Copy link
Contributor Author

slava77 commented Aug 6, 2020

+1

for #31072 bd0bca6

  • changes in the jenkins tests are as expected only in the modified UL re-miniAOD workflow 136.88811

@santocch
Copy link

santocch commented Aug 7, 2020

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 7, 2020

This pull request is fully signed and it will be integrated in one of the next CMSSW_10_6_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_11_2_X is complete. This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

@silviodonato
Copy link
Contributor

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants