Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disabling FLUKA background + Enabling GEM hits into the displaced STA muon reco #18456

Merged
merged 4 commits into from Apr 28, 2017

Conversation

calabria
Copy link
Contributor

@calabria calabria commented Apr 25, 2017

As discussed yesterday at the GMM when running in indeal conditions, all the Muon detectors have to be ideal, so this PR switches off the neutron background description for GE1/1, GE2/1, ME0 and RPC (only in Phase2) and make it the default.

This PR enables also the use of the GE1/1, GE2/1, ME0 hits in the displaced standalone muon reconstruction, missing before by mistake.

@jshlee @kpedro88 @HuguesBrun @drkovalskyi

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @calabria (Cesare Calabria) for master.

It involves the following packages:

RecoMuon/Configuration
SimMuon/GEMDigitizer
SimMuon/RPCDigitizer

@perrotta, @civanch, @mdhildreth, @cmsbuild, @kpedro88, @slava77, @davidlange6 can you please review it and eventually sign? Thanks.
@bellan, @abbiendi, @jhgoh, @echapon, @calderona, @HuguesBrun, @battibass, @trocino, @bachtis, @rociovilar this is something you requested to watch as well.
@Muzaffar, @davidlange6, @smuzaffar you are the release manager for this.

cms-bot commands are listed here #13028

@slava77
Copy link
Contributor

slava77 commented Apr 25, 2017

it could be a good opportunity to replace if fastSim.isChosen(): and if phase2_muon.isChosen(): with toModify or toReplaceWith (whichever is appropriate).

@slava77
Copy link
Contributor

slava77 commented Apr 25, 2017

.. the last comment was for SimMuon/RPCDigitizer/python/muonRPCDigis_cfi.py

@slava77
Copy link
Contributor

slava77 commented Apr 25, 2017

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 25, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/19374/console Started: 2017/04/25 14:30

@civanch
Copy link
Contributor

civanch commented Apr 25, 2017

please test

@cmsbuild
Copy link
Contributor

-1

Tested at: 2ff5539

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-18456/19374/summary.html

I found follow errors while testing this PR

Failed tests: AddOn

  • AddOn:

I found errors in the following addon tests:

cmsDriver.py RelVal -s L1REPACK:Full2015Data --data --scenario=HeavyIons -n 10 --conditions auto:run2_hlt_HIon --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016,Run2_HI --magField 38T_PostLS1 --fileout file:RelVal_Raw_HIon_DATA.root --filein /store/hidata/HIRun2015/HIHardProbes/RAW-RECO/HighPtJet-PromptReco-v1/000/263/689/00000/1802CD9A-DDB8-E511-9CF9-02163E0138CA.root : FAILED - time: date Tue Apr 25 15:31:14 2017-date Tue Apr 25 15:21:23 2017 s - exit: 23552
cmsRun /cvmfs/cms-ib.cern.ch/week1/slc6_amd64_gcc530/cms/cmssw-patch/CMSSW_9_1_X_2017-04-24-1100/src/HLTrigger/Configuration/test/OnLine_HLT_HIon.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Tue Apr 25 15:31:14 2017-date Tue Apr 25 15:21:23 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:HIon,RAW2DIGI,L1Reco,RECO --data --scenario=HeavyIons -n 10 --conditions auto:run2_data_HIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016,Run2_HI --magField 38T_PostLS1 --processName=HLTRECO --filein file:RelVal_Raw_HIon_DATA.root --fileout file:RelVal_Raw_HIon_DATA_HLT_RECO.root : FAILED - time: date Tue Apr 25 15:31:14 2017-date Tue Apr 25 15:21:23 2017 s - exit: 21504
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_GRun2016 --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016 --magField 38T_PostLS1 --fileout file:RelVal_Raw_GRun2016_DATA.root --filein /store/data/Run2016B/JetHT/RAW/v1/000/272/762/00000/C666CDE2-E013-E611-B15A-02163E011DBE.root : FAILED - time: date Tue Apr 25 15:49:52 2017-date Tue Apr 25 15:34:05 2017 s - exit: 23552
cmsRun /cvmfs/cms-ib.cern.ch/week1/slc6_amd64_gcc530/cms/cmssw-patch/CMSSW_9_1_X_2017-04-24-1100/src/HLTrigger/Configuration/test/OnLine_HLT_GRun2016.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Tue Apr 25 15:49:52 2017-date Tue Apr 25 15:34:05 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:GRun2016,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_GRun2016 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016 --magField 38T_PostLS1 --processName=HLTRECO --filein file:RelVal_Raw_GRun2016_DATA.root --fileout file:RelVal_Raw_GRun2016_DATA_HLT_RECO.root : FAILED - time: date Tue Apr 25 15:49:52 2017-date Tue Apr 25 15:34:05 2017 s - exit: 21504

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Pull request #18456 was updated. @perrotta, @civanch, @mdhildreth, @cmsbuild, @kpedro88, @slava77, @davidlange6 can you please check and sign again.

simMuonRPCDigis.InputCollection = 'MuonSimHitsMuonRPCHits'
fastSim.toModify(simMuonRPCDigis, InputCollection = 'MuonSimHitsMuonRPCHits')

simMuonRPCDigisPhaseII = cms.EDProducer("RPCandIRPCDigiProducer",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Better to start this variable name with an underscore, so there won't be an unnecessary process.simMuonRPCDigisPhaseII object.

@kpedro88
Copy link
Contributor

@calabria should this PR go on the list of things needed for the TDR?

@cmsbuild
Copy link
Contributor

Pull request #18456 was updated. @perrotta, @civanch, @mdhildreth, @cmsbuild, @kpedro88, @slava77, @davidlange6 can you please check and sign again.

@calabria
Copy link
Contributor Author

@kpedro88 yes it is needed for the Muon TDR

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-18456/19412/summary.html

Comparison Summary:

  • You potentially added 32 lines to the logs
  • Reco comparison results: 2523 differences found in the comparisons
  • DQMHistoTests: Total files compared: 23
  • DQMHistoTests: Total histograms compared: 1780110
  • DQMHistoTests: Total failures: 24913
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 1755024
  • DQMHistoTests: Total skipped: 173
  • DQMHistoTests: Total Missing objects: 0
  • Checked 94 log files, 14 edm output root files, 23 DQM output files

@slava77
Copy link
Contributor

slava77 commented Apr 26, 2017

@calabria
I'm missing details in the description related to the neutron background settings.

  • what is the meaning of "ideal"? Is it no pileup?
  • what will happen for pileup workflows? should they have these backgrounds enabled? If yes, it should be reflected in this PR. In case it's already done somewhere else, please point me to that.

Please comment
Thank you.

@calabria
Copy link
Contributor Author

calabria commented Apr 26, 2017

Maybe "ideal" here is a bit misleading. For ideal I mean "no neutron background" and "no muon system aging". When present, we will simulate the neutron background with GEANT, and all the muon detectors will share the same approach. It will be mixed together with the PU. Here I am disabling the neutron background description for the GEM/ME0 and RPC subsystems, the only muon detectors adding neutron background as random uncorrelated hits at digi step (based on the FLUKA results). If we simulate the neutron background with GEANT this is no more needed, when we go without neutron background this is also no more needed, so I am switching it off by default.

Concerning the neutron backgrond with GEANT, it is enabled by this customization function:

https://github.com/cms-sw/cmssw/blob/master/SimG4Core/Application/python/NeutronBGforMuons_cff.py

while the correct mixing of the neutron background hits for the muon system will be assured using the following customization function:

https://github.com/cms-sw/cmssw/blob/master/SLHCUpgradeSimulations/Configuration/python/customise_mixing.py#L61

@pietverwilligen , please, correct me if I am wrong.

@slava77
Copy link
Contributor

slava77 commented Apr 26, 2017 via email

@calabria
Copy link
Contributor Author

Yes, of course also ME0. TDR samples with high statistics for the physics studies will not have any aging or neutron background. There will be a small campaign for the muon perfomance studies where we will include aging and neutron background. There is no workflow at the moment I will introduce it, but I will not include it in this PR, it is better this proceed as it is because for the physics samples we need to disable what will not be used and enable the use of the GEM/ME0 hits in the displaced sta muon reconstruction.

@civanch
Copy link
Contributor

civanch commented Apr 27, 2017

+1

@slava77
Copy link
Contributor

slava77 commented Apr 27, 2017 via email

@civanch
Copy link
Contributor

civanch commented Apr 27, 2017

@slava77 , simulation of neutron background with FLUKA and Geant4 are two different things. The advantage of Geant4 that hits are simulated directly, time window for this simulation is 10 seconds (needed to integrate all thermal neutrons). FLUKA do things differently, as I understand, the radiation activity is simulated nearly in the same way as Geant4, radiation is stored per absorber volumes than parametrized, than somehow parametrized radioactivity added on top of digi step.

In both cases not pileup should be added but total neutron radioactive isotope fluxes accumulated over much larger time window. It is known from ATLAS and also from CMS study that these two are in reasonable agreement with the data.

@slava77
Copy link
Contributor

slava77 commented Apr 27, 2017 via email

@civanch
Copy link
Contributor

civanch commented Apr 27, 2017

@slava77 , of course, a special PhysicsList with thermal neutrons and extended time windows are needed , there is a custom fragment for the SIM step.

@calabria
Copy link
Contributor Author

Probably I am not understanding the comments, anyway I believe it would be also funny if only part of the muon system simulates the neutron background (using FLUKA) and the rest does not, bacause CSC and DT are not simulating any neutron background. For this reason we decided to rely only on the common approach offered by the GEANT simulation and to switch off the random hits added only for GEM, ME0 and RPC. Concerning the second part of the comment after the customization I pointed out above the time cut will be set at 10s and for the muon peformance we are requesting to have a window of [-8,+8] (hopefully).

@slava77
Copy link
Contributor

slava77 commented Apr 27, 2017

  • GEM has only two layers and clearly has less intrinsic ability to suppress neutron bgd in local reco
  • ME0 is in a much higher flux environment
    So, it makes much more sense to have this background for these detectors (and not have it in CSC which have built-in readout which requires multi-layer coincidence and DTs which have sufficiently low fluxes).

Anyways, that's not a part of the reco review discussion.

@slava77
Copy link
Contributor

slava77 commented Apr 27, 2017

+1

for #18456 b13a91f

  • related to reco: GEM and ME0 muons are used in STA muon reco across the board now in run3 and phase-2 era setups. This has already been the case for a long time for the standard standAloneMuons. The rest of the PR is disabling DIGI "noise" corresponding to neutron and related backgrounds. This shadows somewhat changes in the standard reco.
  • jenkins tests pass and comparisons with baseline show differences in 2023 workflows in objects starting from ME0, GEM, and RPC rechits and propagate downstream (the effect brought in by the digi change in this PR).

For the expected changes in reco (here and below, looking at jenkins D8 plots)
ME0 and GEM hits are now seen on displaced STA muons
wf23234_dispsta_nh_gem
wf23234_dispsta_nh_me0

The plots below characterize changes related to digi settings modifications.

gem rechits are now just signal
all_oldvsnew_ttbar14tev2023d8wf23234p0c_gemdetidgemrechitsownedrangemap_gemrechits__reco_obj_collection__data__bunchx

this leads to a reduction in the number of segments by about 2
all_oldvsnew_ttbar14tev2023d8wf23234p0c_gemdetidgemsegmentsownedrangemap_gemsegments__reco_obj_collection__data__degreesoffreedom
[I wonder if these are predominantly from overlap regions where segment reco could be more restrictive and require 3 hits]

Similar, for ME0 signal hits are just at t=0
all_oldvsnew_ttbar14tev2023d8wf23234p0c_me0detidme0rechitsownedrangemap_me0rechits__reco_obj_collection__data__tof

The number of ME0 segments is also down by a factor of 2
all_oldvsnew_ttbar14tev2023d8wf23234p0c_log10me0detidme0segmentsownedrangemap_me0segments__reco_obj_collection__data__chi2

Both ME0 and GEM local recos apparently have a large sensitivity to the neutron background (even in the random coincidences generated here).

The number of RPC hits also goes down, by less than a factor of 2 (the backgrounds were not that large apparently)
all_oldvsnew_ttbar14tev2023d8wf23234p0c_rpcdetidrpcrechitsownedrangemap_rpcrechits__reco_obj_collection__data__clustersize

the number of non-tracker (and non-global) muons is down substantively
all_oldvsnew_ttbar14tev2023d8wf23234p0c_booledmvaluemap_muons_muidtmlaststationangtight_reco_obj_values_

@kpedro88
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request requires discussion in the ORP meeting before it's merged. @Muzaffar, @davidlange6, @smuzaffar

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants