Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CaloTowers: adding separate HES/HED depth1 cut #21810

Merged
merged 1 commit into from Jan 12, 2018

Conversation

abdoulline
Copy link

@abdoulline abdoulline commented Jan 8, 2018

No changes expected for eras <= 2017 (cuts kept unchanged).
Some increase of HE N_towers and small addition to energy sums (CaloJets, SumET) expected for >= 2018 due to lowering of HE RecHit cut (both for depth1 and depths2-7) on CaloTowers constituents.

2018 single-pion HE N_towers (vs default reference):
https://cms-cpt-software.web.cern.ch/cms-cpt-software/General/Validation/SVSuite/HCAL/calo_scan_single_pi/100X_2018_CT_HEd1_vs_100X_2018_SinglePi/N_calotowers_HE.gif

HB N_towers is just minimally affected, as there are (more) HE RecHits with |ieta|=16 depth=3
which are included in HB CaloTower |ieta|=16
https://cms-cpt-software.web.cern.ch/cms-cpt-software/General/Validation/SVSuite/HCAL/calo_scan_single_pi/100X_2018_CT_HEd1_vs_100X_2018_SinglePi/N_calotowers_HB.gif

NB:
HES stands for 5-deg phi-segmentation rings (|ieta|<21)
HED - for 10-deg rings (|ieta|>= 21)

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 8, 2018

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 8, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 8, 2018

A new Pull Request was created by @abdoulline (Salavat Abdullin) for master.

It involves the following packages:

RecoLocalCalo/CaloTowersCreator

@perrotta, @cmsbuild, @slava77 can you please review it and eventually sign? Thanks.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@perrotta
Copy link
Contributor

perrotta commented Jan 8, 2018

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 8, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/25326/console Started: 2018/01/08 11:21

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 8, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 8, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 8, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-21810/25326/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /build/cmsbld/jenkins-workarea/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-21810/1325.7_TTbar_13_94XNanoAODINPUT+TTbar_13_94XNanoAODINPUT+NANOEDMMC2017

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 134 differences found in the comparisons
  • DQMHistoTests: Total files compared: 26
  • DQMHistoTests: Total histograms compared: 2775243
  • DQMHistoTests: Total failures: 3211
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2771863
  • DQMHistoTests: Total skipped: 169
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 1.0599999999 KiB( 22 files compared)
  • Checked 110 log files, 9 edm output root files, 26 DQM output files

@perrotta
Copy link
Contributor

perrotta commented Jan 9, 2018

From the jenkins tests (wf 10824, TTbar13TeV2018) this plot shows the increase of selected CaloTowers in the HE region wrt current 2018 thresholds:

image

This can be compared with the same distribution in the 2017 "legacy collapsed" workflow 10024

ttbar2017

If I understand it correctly, these (low stat, 10 evts each) figures confirm what was said in the presentation of Maria at today's XPOG mtg
https://indico.cern.ch/event/690484/contributions/2839820/attachments/1580119/2496698/dalfonso_xPOG_jan9.pdf
that is the new thresholds (red in the top figure) are a bit looser than the legacy ones (figure below), and quite looser than the 0,8 GeV threshold applied to the 2018 HE depth segmentation (black in the top figure): am I correct?

@abdoulline
Copy link
Author

Andrea, 2018 vs 2017 is somewhat affected by different primary DIGIs (number of readouts -> rndm), so not quite apples-to-apples anyway on 10 ev. Actually the question is whether 2017 and 2018 TTbar comes form the same GEN-SIM here?
y
What I can summarize -
(1) 2017 HE CaloTowers are produced with the cut 0.8 GeV applied on "legacy" 2-3 depths.
(2) 2018 HE CaloTowers are produced with the cut 0.8 GeV applied on every of "upgraded" 6-7 depths.
And the electronics noise in (1) is quite big, so "pushing" also for additional HE CaloTowers.
While in (2) the noise is very small.

So in general (2) yields less CaloTowers and energy sum (e.g. for cluster) is smaller.
That's what I see in my single-pion high-stat tests.

(3) 2018 HE CaloTowers in this PR use loose cuts of 0.1(0.2) GeV on depths1(2-7) so there more CaloTowers get produced (and clustered energy sum is higher).

But I must admit in my single-pion tests, HE N_towers in (3) is still somewhat less than N_towers in (1), as the latter is probably dominated by high nose of legacy QIE8 electronics.
While here in the TTbar plots (3) is certainly above (1), what I'd expect from real hits.

@perrotta
Copy link
Contributor

Since I produced them, here follows a few additional comparison of the same 10824, TTbar13TeV2018 workflow with slightly larger stat. The big summary is that, together with calo towers, the number of jets also increase, while electron and photons get somehow reduced by the larger HAD content in their showers:

image

image

image

image

@perrotta
Copy link
Contributor

And here is the comparison of the event sizes (no PU...), which mirrors the observations in the previous post here:

-----------------------------------------------------------------
   or, B         new, B      delta, B   delta, %   deltaJ, %    branch 
-----------------------------------------------------------------
    539.1 ->       552.6         13      2.5   0.00     recoCaloJets_ak4CaloJets__RECO.
    462.8 ->       455.6         -7     -1.6  -0.00     recoPFCandidates_particleFlowEGamma__RECO.
   1790.5 ->      1744.6        -46     -2.6  -0.01     recoConversions_allConversions__RECO.
  12423.8 ->     12057.4       -366     -3.0  -0.07     recoGsfTrackExtras_electronGsfTracks__RECO.
   1229.1 ->      1222.1         -7     -0.6  -0.00     recoSuperClusters_particleFlowEGamma__RECO.
    152.9 ->       149.2         -4     -2.4  -0.00     recoCandidateedmPtrrecoTemplatedSoftLeptonTagInfos_softPFElectronsTagInfos__RECO.
    200.2 ->       202.2          2      1.0   0.00     recoJetIDedmValueMap_ak4JetID__RECO.
    224.1 ->       225.2          1      0.5   0.00     recoJetedmRefToBaseProdTorecoJetExtendedAssociationJetExtendedDatasAssociationVector_ak4JetExtender__RECO.
   4045.4 ->      4044.3         -1     -0.0  -0.00     recoCandidateedmPtrsrecoJetTagInforecoIPTagInfos_pfImpactParameterTagInfos__RECO.
  15443.5 ->     15438.7         -5     -0.0  -0.00     recoTracks_generalTracks__RECO.
   8859.4 ->      8832.3        -27     -0.3  -0.00     recoPFBlocks_particleFlowBlock__RECO.
    512.6 ->       509.8         -3     -0.6  -0.00     recoCandidateedmPtrsrecoJetTagInforecoIPTagInforecoVertexCompositePtrCandidaterecoTemplatedSecondaryVertexTagInfos_pfInclusiveSecondaryVertexFinderTagInfos__RECO.
    577.1 ->       579.9          3      0.5   0.00     recoJPTJets_JetPlusTrackZSPCorJetAntiKt4__RECO.
    870.6 ->       842.7        -28     -3.2  -0.01     recoGsfTracks_electronGsfTracks__RECO.
  24007.4 ->     27616.9       3610     14.0   0.66     CaloTowersSorted_towerMaker__RECO.
    589.5 ->       588.2         -1     -0.2  -0.00     recoCandidateedmPtrsrecoJetTagInforecoIPTagInforecoVertexCompositePtrCandidaterecoTemplatedSecondaryVertexTagInfos_pfInclusiveSecondaryVertexFinderCvsLTagInfos__RECO.
   1448.4 ->      1440.3         -8     -0.6  -0.00     recoCaloClusters_particleFlowEGamma_EBEEClusters_RECO.
    660.6 ->       632.6        -28     -4.3  -0.01     recoGsfElectrons_gedGsfElectrons__RECO.
  14879.1 ->     14876.1         -3     -0.0  -0.00     recoPFCandidates_particleFlow__RECO.
    955.9 ->       954.0         -2     -0.2  -0.00     recoCaloClusters_particleFlowEGamma_ESClusters_RECO.
    823.7 ->       816.8         -7     -0.8  -0.00     recoPhotons_photons__RECO.
   5021.9 ->      5009.4        -13     -0.2  -0.00     EcalRecHitsSorted_reducedEcalRecHitsEB__RECO.
   1393.3 ->      1318.4        -75     -5.5  -0.01     recoElectronSeeds_electronMergedSeeds__RECO.
   2753.0 ->      2665.0        -88     -3.2  -0.02     recoTrackExtras_electronGsfTracks__RECO.
    939.5 ->       936.3         -3     -0.3  -0.00     recoPhotons_gedPhotons__RECO.
    685.7 ->       704.9         19      2.8   0.00     recoHcalNoiseRBXs_hcalnoise__RECO.
    132.0 ->       136.3          4      3.1   0.00     recoIsoDepositedmValueMap_muIsoDepositCalByAssociatorTowers_hcal_RECO.
    661.8 ->       647.1        -15     -2.2  -0.00     TrackingRecHitsOwned_electronGsfTracks__RECO.
     83.2 ->        81.0         -2     -2.6  -0.00     recoPhotonCores_gedPhotonCore__RECO.
-------------------------------------------------------------
   546443 ->      549352       2908             0.5     ALL BRANCHES

Overal, 0.5% additional reco content in the step3 output.

In the miniAOD output the CaloTowers are not saved, and therefore overall there is a size reduction instead, here by 0.2%:

-----------------------------------------------------------------
   or, B         new, B      delta, B   delta, %   deltaJ, %    branch 
-----------------------------------------------------------------
    847.0 ->       811.7        -35     -4.3  -0.09     recoConversions_reducedEgamma_reducedConversions_RECO.
   1361.2 ->      1298.9        -62     -4.7  -0.15     patElectrons_slimmedElectrons__RECO.
    513.8 ->       510.1         -4     -0.7  -0.01     recoSuperClusters_reducedEgamma_reducedSuperClusters_RECO.
    313.1 ->       287.7        -25     -8.5  -0.06     recoGsfTracks_reducedEgamma_reducedGsfTracks_RECO.
   1009.1 ->      1033.8         25      2.4   0.06     patPhotons_slimmedPhotons__RECO.
   4635.2 ->      4633.9         -1     -0.0  -0.00     patPackedCandidates_packedPFCandidates__RECO.
    324.0 ->       327.9          4      1.2   0.01     EcalRecHitsSorted_reducedEgamma_reducedEERecHits_RECO.
    750.4 ->       745.4         -5     -0.7  -0.01     EcalRecHitsSorted_reducedEgamma_reducedEBRecHits_RECO.
    509.1 ->       532.4         23      4.5   0.06     recoCaloClusters_reducedEgamma_reducedESClusters_RECO.
    320.6 ->       331.4         11      3.3   0.03     EcalRecHitsSorted_reducedEgamma_reducedESRecHits_RECO.
    145.8 ->       147.5          2      1.2   0.00     recoCaloJets_slimmedCaloJets__RECO.
     65.5 ->        64.4         -1     -1.7  -0.00     recoConversions_reducedEgamma_reducedSingleLegConversions_RECO.
    644.0 ->       639.2         -5     -0.7  -0.01     recoCaloClusters_reducedEgamma_reducedEBEEClusters_RECO.
     91.0 ->        92.6          2      1.8   0.00     patPackedCandidates_lostTracks__RECO.
   1456.2 ->      1457.4          1      0.1   0.00     patMuons_slimmedMuons__RECO.
-------------------------------------------------------------
    41337 ->       41264        -73            -0.2     ALL BRANCHES

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@slava77
Copy link
Contributor

slava77 commented Jan 10, 2018 via email

@perrotta
Copy link
Contributor

In SingleElectronPt35in2018 wf 10802 the number of additional CaloTowers is less relevant than in TTbar:

all_testpr21810vsorig_singleelectronpt35in2018wf10802p0c_calotowerssorted_towermaker__reco_obj_obj_eta

The number of reconstructed electrons and photons is apparently unchanged, in spite of some little effect on the energy content:

all_testpr21810vsorig_singleelectronpt35in2018wf10802p0c_recogsfelectrons_gedgsfelectrons__reco_obj_caloenergy

all_testpr21810vsorig_singleelectronpt35in2018wf10802p0c_recophotons_gedphotons__reco_obj_energy

@slava77 : I think this answers your doubt in #21810 (comment)

@abdoulline
Copy link
Author

abdoulline commented Jan 11, 2018 via email

@fabiocos
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 8d2ca5d into cms-sw:master Jan 12, 2018
@abdoulline abdoulline deleted the CaloTowers_HEdepth1 branch April 17, 2018 15:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants