[JME NanoAOD] Backport of #32722 (Changes for event size reduction) to 10_6_X

[nurfikri89]

Backport from #32722

PR description:

This PR is to reduce the size of custom JME NanoAODs. The following changes are made:

• Check that npuProd[ibx].getPU_pT_hats() size is more than 0 in PhysicsTools/NanoAOD/plugins/NPUTablesProducer.cc.
• Switch on storing Parton Shower (PS) weights.
• b-tagging algorithm outputs are saved for AK4 jets with pT > 15 GeV.
• Low-level input variables for PileUp jet ID and Quark-Gluon Likelihood are saved for AK4 jets with pT > 10 GeV.
• Remove AK4 PF and AK8 PF jet collections.
• Add separate AK8 GEN and AK8 Puppi jet collections for JEC studies. Minimal information are saved.
• For reclustered GEN jet collections, the minimum pT at the jet clustering level uses the default value (3 GeV) in RecoJets/JetProducers/python/ak4GenJets_cfi.py.
• For reclustered reco-level jet collections, the minimum pT at the jet clustering level is set to be 0. Then, only jets with (JEC-corrected) pT > 8 GeV are saved. Additionally for MC samples, jets with pT < 8 GeV are saved if they are matched to GEN jets.

With this PR, the event size is now reduced to 6.42 kb/event from 9.32 kb/event. The comparison was made using 10K events from a TTJets RunIISummer19UL17MiniAOD sample. The changes in this PR was discussed in the 13/01/2021 XPOG meeting [1].

[1] https://indico.cern.ch/event/978436/

if this PR is a backport please specify the original PR:

Original PR is #32722

[cmsbuild]

A new Pull Request was created by @nurfikri89 (Nurfikri Norjoharuddeen) for CMSSW_10_6_X.

It involves the following packages:

PhysicsTools/NanoAOD
PhysicsTools/PatAlgos

@perrotta, @gouskos, @cmsbuild, @fgolf, @slava77, @jpata, @mariadalfonso can you please review it and eventually sign? Thanks.
@jdamgov, @emilbols, @gouskos, @swertz, @jdolen, @ahinzmann, @smoortga, @schoef, @rappoccio, @mariadalfonso, @JyothsnaKomaragiri, @nhanvtran, @gkasieczka, @clelange, @hatakeyamak, @ferencek, @gpetruc, @andrzejnovak, @peruzzim, @seemasharmafnal, @mmarionncern this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

• Backported from [JME NanoAOD] Changes for event size reduction #32722

[slava77]

please test workflow 25202.15,10224.15,11024.15

(assuming the wf indices are the same in 106X)

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-796a38/12582/summary.html
COMMIT: 7b84fce
CMSSW: CMSSW_10_6_X_2021-01-28-1100/slc7_amd64_gcc700
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/32759/12582/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 35
• DQMHistoTests: Total histograms compared: 3215540
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3215205
• DQMHistoTests: Total skipped: 334
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 34 files compared)
• Checked 143 log files, 29 edm output root files, 35 DQM output files

[slava77]

backport of #32722

[slava77]

+1

for #32759 7b84fce

• the backport is correct (the diffs here and in [JME NanoAOD] Changes for event size reduction #32722 are the same); this PR is not affecting the production reco or re-miniAOD
• jenkins tests pass and comparisons with the baseline show no differences

[gouskos]

+xpog

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_10_6_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_11_3_X is complete. This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

[silviodonato]

+1