Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HCAL: slimmed collections with non-0 noise flags RecHits for miniAOD #31375

Merged
merged 6 commits into from Sep 12, 2020

Conversation

abdoulline
Copy link

@abdoulline abdoulline commented Sep 7, 2020

PR description:

Two tiny-size "simmedHcalRecHits" collections
(HBHERecHitsSorted_slimmedHcalRecHits and HFRecHitsSorted_slimmedHcalRecHits) added to minAOD.

They contain solely RecHits with non-0 (noise) flags set. This is "slimmed" version (without HcalRecHits "interesting" for Egamma) of "reducedHcalRecHits" collections included in AOD.
Having them in minAOD would help to better asses the effect of HCAL noise in physics analyses.

Comes out from a discussion between HCAL DPG and JetMET.

PR validation:

(1)
For 136.88811_RunJetHT2018D... (100 ev) -
reminiAOD (step2) : the size of files: new 10121622, std/reference 10116469 -> factor 1.0005
New collections contain (per 100 ev): 2 HBHERecHits and 13 HF RecHits respectively

(2)
Estimates on bigger statistics
2018D JetHT RelVal with ~3.37*10^5 ev

https://cms-cpt-software.web.cern.ch/cms-cpt-software/General/Validation/SVSuite/HCAL/1100pre6_110X_dataRun2_PromptLike_v3_RelVal_2018D-v1_vs_1100pre5_110X_dataRun2_PromptLike_Candidate_2019_08_02_16_53_14_RelVal_2018D-v1_RelVal/JetHT/RecHits/index.html

HBRecHits with non-0 flags ~4x10^-2 / ev
HERecHits with non-0 flags ~6x10^-3 / ev
HFRecHits with non-0 flags ~0.15 / ev

So, 1 RecHit per ~6 JetHT 2018 events.

(3)
runTheMatrix.py -l limited is OK

if this PR is a backport

No

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2020

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2020

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-31375/18195

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2020

A new Pull Request was created by @abdoulline (Salavat Abdullin) for master.

It involves the following packages:

PhysicsTools/PatAlgos
RecoLocalCalo/HcalRecProducers

@perrotta, @jpata, @cmsbuild, @santocch, @slava77 can you please review it and eventually sign? Thanks.
@rappoccio, @gouskos, @hatakeyamak, @emilbols, @peruzzim, @seemasharmafnal, @mmarionncern, @apsallid, @ahinzmann, @smoortga, @jdolen, @ferencek, @jdamgov, @nhanvtran, @gkasieczka, @schoef, @andrzejnovak, @clelange, @riga, @JyothsnaKomaragiri, @gpetruc, @mariadalfonso this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

@perrotta
Copy link
Contributor

perrotta commented Sep 7, 2020

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2020

The tests are being triggered in jenkins.

@abdoulline abdoulline changed the title HCAL: slimmed RecHits collections with non-0 noise flags for minAOD HCAL: slimmed collections with non-0 noise flags RecHits for miniAOD Sep 7, 2020
@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2020

+1
Tested at: c17a680
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-76cbad/9159/summary.html
CMSSW: CMSSW_11_2_X_2020-09-06-2300
SCRAM_ARCH: slc7_amd64_gcc820

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2020

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2020

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-76cbad/9159/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 2 differences found in the comparisons
  • DQMHistoTests: Total files compared: 35
  • DQMHistoTests: Total histograms compared: 2609667
  • DQMHistoTests: Total failures: 23
  • DQMHistoTests: Total nulls: 1
  • DQMHistoTests: Total successes: 2609621
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.004 KiB( 34 files compared)
  • DQMHistoSizes: changed ( 10224.0 ): 0.004 KiB MessageLogger/Warnings
  • Checked 149 log files, 22 edm output root files, 35 DQM output files

@abdoulline
Copy link
Author

abdoulline commented Sep 7, 2020

DQM bin-by-bin comparison:
known ("deja vu") issue in Validation/GlobalRecHits/HCals : iterates over all the HCAL RecHits collections with getByType, so adding new ones (this case) may change the number of entries

https://cmsweb.cern.ch/dqm/dev/start?runnr=1;dataset%3D/RelVal_wf10224_0_pr/CMSSW_11_2_X-PRcmssw_31375-9159/DQMIO;referenceshow%3Dall;referencenorm=False;referenceobj1%3Dother::/RelVal_wf10224_0_base/CMSSW_11_2_X-PRcmssw_31375-9159/DQMIO::;sampletype%3Doffline_relval;workspace%3DEverything;

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 8, 2020

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-76cbad/9201/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 35
  • DQMHistoTests: Total histograms compared: 2609667
  • DQMHistoTests: Total failures: 19
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2609626
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 34 files compared)
  • Checked 149 log files, 22 edm output root files, 35 DQM output files

@jpata
Copy link
Contributor

jpata commented Sep 9, 2020

+reconstruction

slava77 pushed a commit to slava77/cms-bot that referenced this pull request Sep 9, 2020
- for slimmed/reduced muon clusters/extras from cms-sw/cmssw#31217: add some basic plots or `reco::TrackExtra` and the associated pixel/strip clusters
    - comes with some refactoring of existing plotting methods for the tracker clusters
- for slimmedHcalRecHits from cms-sw/cmssw#31375 : basic plots for HBHE/HO/HF hits are added
    - comes with some refactoring of existing plotting methods for the calo rec hits
- add a plot for hbhe rechits chi2 after some minimal energy cut
- add pat Electron and Muon BS2D and PV2D plots
- adjust the stats text and the exponent label offset for x and y axis plots to avoid/minimize overlapping or invisible text
@abdoulline
Copy link
Author

@santocch could you sign, please?

@santocch
Copy link

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

@qliphy
Copy link
Contributor

qliphy commented Sep 12, 2020

+1

@slava77
Copy link
Contributor

slava77 commented Sep 18, 2020

@abdoulline
was this planned to be backported to 10_6_X as well?

@abdoulline
Copy link
Author

abdoulline commented Sep 18, 2020 via email

@lathomas
Copy link
Contributor

Hello. Yes I think it would be nice to have it in 106X.
Thanks !

@abdoulline
Copy link
Author

Hello. Yes I think it would be nice to have it in 106X.
Thanks !

OK Laurent, will do it later today.

cmsbuild added a commit that referenced this pull request Sep 23, 2020
…106X

10_6_X backport of  "HCAL: slimmed collections... for miniAOD" (PR #31375)
@abdoulline abdoulline deleted the slimmedHcalRecHits_MINIAOD branch June 6, 2021 17:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants