bsunanda:Run2-alca52 Add AlCaReo stream for muon events #15266

bsunanda · 2016-07-22T20:21:49Z

This is in view of disappearance of RECO data. Need AlCaRecoSelector for calibrating HB/HE with muons. This is in preparation for calibration of 2017 data. Data volume required is ~1.6 TB per 1 /fb integrated luminosity with the latest correction

bsunanda · 2016-07-22T20:22:04Z

@cmsbuild Please test

cmsbuild · 2016-07-22T20:22:14Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/14214/console

cmsbuild · 2016-07-22T20:22:15Z

A new Pull Request was created by @bsunanda for CMSSW_8_1_X.

It involves the following packages:

Calibration/HcalAlCaRecoProducers

@ghellwig, @cerminar, @cmsbuild, @franzoni, @mmusich, @davidlange6 can you please review it and eventually sign? Thanks.
@ghellwig, @tocheng this is something you requested to watch as well.
@slava77, @smuzaffar you are the release manager for this.

cms-bot commands are list here #13028

bsunanda · 2016-07-24T17:57:29Z

@cmsbuild Please test

cmsbuild · 2016-07-24T17:57:48Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/14216/console

cmsbuild · 2016-07-24T19:00:09Z

+1
Tested at: a68bef0
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-15266/14216/summary.html

cmsbuild · 2016-07-24T19:47:00Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-15266/14216/summary.html

mmusich · 2016-07-25T09:12:54Z

@bsunanda few comments questions.
If this has to be run at Tier-0 you will need to update also:

Configuration/StandardSequences/python/AlCaRecoStreams_cff.py
Configuration/EventContent/python/AlCaRecoOutput_cff.py
Configuration/AlCa/python/autoAlCa.py

just as you did for HcalCalIsoTrkFilter in #13251.

Also, what is the expected data volume generated by this AlCaReco?

mmusich · 2016-07-25T15:17:39Z

Calibration/HcalAlCaRecoProducers/python/alcaHBHEMuonFilter_cfi.py

@@ -5,5 +5,5 @@
                                  TriggerResultLabel= cms.InputTag("TriggerResults","","HLT"),
                                  MuonLabel         = cms.InputTag("muons"),
                                  MinimumMuonP      = cms.double(10.0),
-                                  Triggers           = cms.vstring("HLT_IsoMu17","HLT_IsoMu20","HLT_IsoMu24","HLT_IsoMu27","HLT_Mu45","HLT_Mu50"),
+                                  Triggers           = cms.vstring("HLT_IsoMu","HLT_Mu"),


@bsunanda shouldn't this contain a wildcard like HLT_IsoMu* ?

mmusich · 2016-07-25T15:22:40Z

For the record, an answer to my previous question was given during the AlCa/DB meeting Jul 25th.

Propagation of the AlCa producer to the Configuration package on hold, since the the producer is being finalized for 2017 production.
The expected data volume is 10TB/fb (which is too high to sustain). Hcal experts to reduce the rate by imposing a pT cut (currently under study) to reduce throughput by a factor 5-10.

bsunanda · 2016-07-25T15:57:59Z

@mmusich It is like a wild card - within the code it looks for "HLT_IsoMu" in the trigger path. We shall update the momentum cut and trigger names to make the disk requirement to something affordable. At that time we introduce changes in the 3 cff files.

mmusich · 2016-07-25T16:18:02Z

+1

cmsbuild · 2016-08-23T01:01:20Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/14653/console

cmsbuild · 2016-08-23T02:43:11Z

+1
Tested at: bebf9c4
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-15266/14653/summary.html

cmsbuild · 2016-08-23T03:24:29Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-15266/14653/summary.html

bsunanda · 2016-08-23T10:46:20Z

@mmusich @ggovi Could you please approve this PR now?

franzoni · 2016-08-23T16:02:58Z

@bsunanda

from the discussion at yesterday's ALCa/DB meeting https://indico.cern.ch/event/560332/contributions/2280818/attachments/1325371/1989361/Phase1-Talk06.pdf
it remains clear that 1.6/1.9 TB/fb do not fit the budget for ALCARECO currently available to the overall AlCa/Db phedex group.

We asked what is the dependence of the performance of this calibration as a function of statistics, the answer to which question remains to be quantified.

We agreed on moving this PR forward to expand the studies and either reduce the rate or build a solid physics case for the resources you ask.

franzoni · 2016-08-23T16:03:03Z

+1

cmsbuild · 2016-08-23T16:03:18Z

This pull request is fully signed and it will be integrated in one of the next CMSSW_8_1_X IBs (tests are also fine). This pull request requires discussion in the ORP meeting before it's merged. @slava77, @davidlange6, @smuzaffar

bsunanda · 2016-08-24T10:49:23Z

@davidlange6 Please merge this PR

davidlange6 · 2016-08-25T13:31:59Z

not that my comment was really addressed - but I tried adding this to a workflow as it is not normally tested in the short matrix. I don't see big issues, however do we really need the dozens of value maps from muons?

mmusich · 2016-08-25T13:36:34Z

@davidlange6

as it is not normally tested in the short matrix.

it actually is, via wf. 1000.0, or that's not what you are referring to?
see: HcalCalHBHEMuonFilter.root

bsunanda · 2016-08-25T14:50:29Z

@davidlange6 We find that dropping some of the value maps we cannot proceed with the next step of final calibration. We tested that by dropping one at a time

davidlange6 · 2016-08-26T08:38:51Z

+1

@bsunanda - bizarre to have developed such a calibration. but ok

cmsbuild added this to the Next CMSSW_8_1_X milestone Jul 22, 2016

cmsbuild added alca-pending pending-signatures tests-pending orp-pending comparison-pending labels Jul 22, 2016

cmsbuild added tests-started and removed tests-pending labels Jul 22, 2016

bsunanda changed the title ~~Add AlCaReo stream for muon events~~ bsunanda:Run2-alca52 Add AlCaReo stream for muon events Jul 24, 2016

cmsbuild added tests-pending and removed tests-started labels Jul 24, 2016

cmsbuild added tests-started and removed tests-pending labels Jul 24, 2016

cmsbuild added tests-approved and removed tests-started labels Jul 24, 2016

cmsbuild added comparison-available and removed comparison-pending labels Jul 24, 2016

mmusich reviewed Jul 25, 2016
View reviewed changes

cmsbuild removed the alca-pending label Jul 25, 2016

cmsbuild added tests-pending and removed tests-rejected labels Aug 23, 2016

cmsbuild added tests-started and removed tests-pending labels Aug 23, 2016

cmsbuild added tests-approved and removed tests-started labels Aug 23, 2016

cmsbuild added comparison-available and removed comparison-pending labels Aug 23, 2016

cmsbuild added alca-approved operations-approved fully-signed and removed alca-pending operations-pending pending-signatures labels Aug 23, 2016

cmsbuild added orp-approved and removed orp-pending labels Aug 26, 2016

cmsbuild merged commit a610206 into cms-sw:CMSSW_8_1_X Aug 26, 2016

mmusich mentioned this pull request Aug 30, 2016

bsunanda:Run2-alca59 Backport pull request from 8_1_X for AlCaReco stream with muons in HB/HE #15551

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

bsunanda:Run2-alca52 Add AlCaReo stream for muon events #15266

bsunanda:Run2-alca52 Add AlCaReo stream for muon events #15266

bsunanda commented Jul 22, 2016 •

edited

bsunanda commented Jul 22, 2016

cmsbuild commented Jul 22, 2016 •

edited

cmsbuild commented Jul 22, 2016

bsunanda commented Jul 24, 2016

cmsbuild commented Jul 24, 2016 •

edited

cmsbuild commented Jul 24, 2016

cmsbuild commented Jul 24, 2016

mmusich commented Jul 25, 2016 •

edited

mmusich Jul 25, 2016

mmusich commented Jul 25, 2016

bsunanda commented Jul 25, 2016

mmusich commented Jul 25, 2016

cmsbuild commented Aug 23, 2016 •

edited

cmsbuild commented Aug 23, 2016

cmsbuild commented Aug 23, 2016

bsunanda commented Aug 23, 2016

franzoni commented Aug 23, 2016

franzoni commented Aug 23, 2016

cmsbuild commented Aug 23, 2016

bsunanda commented Aug 24, 2016

davidlange6 commented Aug 25, 2016

mmusich commented Aug 25, 2016

bsunanda commented Aug 25, 2016

davidlange6 commented Aug 26, 2016

bsunanda:Run2-alca52 Add AlCaReo stream for muon events #15266

bsunanda:Run2-alca52 Add AlCaReo stream for muon events #15266

Conversation

bsunanda commented Jul 22, 2016 • edited

bsunanda commented Jul 22, 2016

cmsbuild commented Jul 22, 2016 • edited

cmsbuild commented Jul 22, 2016

bsunanda commented Jul 24, 2016

cmsbuild commented Jul 24, 2016 • edited

cmsbuild commented Jul 24, 2016

cmsbuild commented Jul 24, 2016

mmusich commented Jul 25, 2016 • edited

mmusich Jul 25, 2016

Choose a reason for hiding this comment

mmusich commented Jul 25, 2016

bsunanda commented Jul 25, 2016

mmusich commented Jul 25, 2016

cmsbuild commented Aug 23, 2016 • edited

cmsbuild commented Aug 23, 2016

cmsbuild commented Aug 23, 2016

bsunanda commented Aug 23, 2016

franzoni commented Aug 23, 2016

franzoni commented Aug 23, 2016

cmsbuild commented Aug 23, 2016

bsunanda commented Aug 24, 2016

davidlange6 commented Aug 25, 2016

mmusich commented Aug 25, 2016

bsunanda commented Aug 25, 2016

davidlange6 commented Aug 26, 2016

bsunanda commented Jul 22, 2016 •

edited

cmsbuild commented Jul 22, 2016 •

edited

cmsbuild commented Jul 24, 2016 •

edited

mmusich commented Jul 25, 2016 •

edited

cmsbuild commented Aug 23, 2016 •

edited