Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prompt DQM for Pure MET Triggers 93X #19689

Merged
merged 61 commits into from
Jul 18, 2017

Conversation

physicist87
Copy link
Contributor

https://its.cern.ch/jira/browse/CMSHLT-1421

This PR is for Pure MET Triggers.

This PR is related to #19685

We only modified METMonitor_cff.py to add MET Triggers.

Aliya Nigamova and others added 30 commits May 29, 2017 15:15
hltinputag correction
added new paths for reference method
using triggerSummary instead of TriggerResults
solved the problem with InputTag
@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs after it passes the integration tests. This pull request requires discussion in the ORP meeting before it's merged. @davidlange6, @smuzaffar

@fwyzard
Copy link
Contributor

fwyzard commented Jul 12, 2017

@physicist87 if you don't mind, I will include your commits in a single PR where I am merging other changes, to avoid conflicts with other PRs.

We should keep this PR open until the other is merged.

fwyzard added a commit to fwyzard/cmssw that referenced this pull request Jul 12, 2017
@fwyzard
Copy link
Contributor

fwyzard commented Jul 12, 2017

@davidlange6 this PR is signed by DQM, and I think the changes are only in the python configuration.

Do you have any objections if I include it in a second "merged" PR to fix the various conflicts ?

@cmsbuild
Copy link
Contributor

-1

Tested at: 2ce204c

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
de56eaa
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19689/21381/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19689/21381/git-merge-result

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19689/21381/summary.html

I found follow errors while testing this PR

Failed tests: RelVals

  • RelVals:

When I ran the RelVals I found an error in the following worklfows:
5.1 step2

runTheMatrix-results/5.1_TTbar+TTbarFS+HARVESTFS/step2_TTbar+TTbarFS+HARVESTFS.log

135.4 step2
runTheMatrix-results/135.4_ZEE_13+ZEEFS_13+HARVESTUP15FS+MINIAODMCUP15FS/step2_ZEE_13+ZEEFS_13+HARVESTUP15FS+MINIAODMCUP15FS.log

8.0 step5
runTheMatrix-results/8.0_BeamHalo+BeamHalo+DIGICOS+RECOCOS+ALCABH+HARVESTCOS/step5_BeamHalo+BeamHalo+DIGICOS+RECOCOS+ALCABH+HARVESTCOS.log

4.22 step5
runTheMatrix-results/4.22_RunCosmics2011A+RunCosmics2011A+RECOCOSD+ALCACOSD+SKIMCOSD+HARVESTDC/step5_RunCosmics2011A+RunCosmics2011A+RECOCOSD+ALCACOSD+SKIMCOSD+HARVESTDC.log

136.7611 step3
runTheMatrix-results/136.7611_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016+HARVESTDR2_REMINIAOD_data2016/step3_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016+HARVESTDR2_REMINIAOD_data2016.log

1003.0 step3
runTheMatrix-results/1003.0_RunMinBias2012A+RunMinBias2012A+RECODDQM+HARVESTDDQM/step3_RunMinBias2012A+RunMinBias2012A+RECODDQM+HARVESTDDQM.log

1306.0 step4
runTheMatrix-results/1306.0_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15/step4_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15.log

140.53 step3
runTheMatrix-results/140.53_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI/step3_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI.log

1000.0 step4
runTheMatrix-results/1000.0_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT/step4_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT.log

1330.0 step4
runTheMatrix-results/1330.0_ZMM_13+ZMM_13+DIGIUP15+RECOUP15+HARVESTUP15/step4_ZMM_13+ZMM_13+DIGIUP15+RECOUP15+HARVESTUP15.log

10042.0 step5
runTheMatrix-results/10042.0_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step5_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

9.0 step4
runTheMatrix-results/9.0_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST/step4_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST.log

4.53 step4
runTheMatrix-results/4.53_RunPhoton2012B+RunPhoton2012B+HLTD+RECODR1reHLT+HARVESTDR1reHLT/step4_RunPhoton2012B+RunPhoton2012B+HLTD+RECODR1reHLT+HARVESTDR1reHLT.log

25.0 step4
runTheMatrix-results/25.0_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT/step4_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT.log

10024.0 step5
runTheMatrix-results/10024.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step5_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

10824.0 step5
runTheMatrix-results/10824.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018/step5_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018.log

50202.0 step4
runTheMatrix-results/50202.0_TTbar_13+TTbar_13+DIGIUP15_PU50+RECOUP15_PU50+HARVESTUP15_PU50/step4_TTbar_13+TTbar_13+DIGIUP15_PU50+RECOUP15_PU50+HARVESTUP15_PU50.log

136.731 step4
runTheMatrix-results/136.731_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2/step4_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2.log

20034.0 step4
runTheMatrix-results/20034.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17/step4_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17.log

25202.0 step4
runTheMatrix-results/25202.0_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25/step4_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25.log

20434.0 step4
runTheMatrix-results/20434.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19/step4_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19.log

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
de56eaa
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19689/21381/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19689/21381/git-merge-result

@cmsbuild
Copy link
Contributor

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

@davidlange6
Copy link
Contributor

hi @fwyzard - i can't really comment - this PR looks to contain several others, so I don't know what the new/unique stuff in this PR actually is..

@fwyzard
Copy link
Contributor

fwyzard commented Jul 12, 2017

These PR have been forced to include others' developments, because there were not being integrated.

How do you suggest to proceed ?

.A

@physicist87
Copy link
Contributor Author

@fwyzard This pr has problem during Test. Should I fix it ? I think I missed your last commit (remove multiple definition of the same modules : c6f3814).
Should I fix this PR ?

@fwyzard
Copy link
Contributor

fwyzard commented Jul 13, 2017

@davidlange6 for example you could look at the commit history.
AFAICT only the last two commits are new for this PR

and they touch only the python configuration

  • DQMOffline/Trigger/python/METMonitor_cff.py

I am going to include these changes directly in #19685 or in a follow up PR.

@davidlange6
Copy link
Contributor

davidlange6 commented Jul 13, 2017 via email

@fwyzard
Copy link
Contributor

fwyzard commented Jul 13, 2017

hi David,
@physicist87 should answer about the number of bins.

The reason for picking up the previous PRs is because you keep not merging them, so I'm doing it in #19685 to avoid having to resolve conflicts every single time.

I did do the merge locally, and as I wrote the only changes introduced by this PR are in DQMOffline/Trigger/python/METMonitor_cff.py

You comments about the code then should be addressed to the relevant PR.

@fwyzard fwyzard mentioned this pull request Jul 13, 2017
@davidlange6
Copy link
Contributor

davidlange6 commented Jul 13, 2017 via email

@fwyzard
Copy link
Contributor

fwyzard commented Jul 13, 2017

Sorry I cannot work that way (since I'm bad at guessing). We need PRs that have independent changes. Of course sometimes a PR will have to pick up some changes and then rebased if the same piece of a file is changed by multiple PRs. But that is not what we are talking about.

That would have been possible one and a half months ago.

In the meantime the PRs accumulated, done by over 10 different people for the same or different code base and python configurations, merging one another and conflicting with one another.

So, now I'm trying to sort out the mess.

What I would ask is to trust what I tell you about which commits "belong" to each PR, in order to base you comments only on the relevant part, and to let me know which ones you consider "ok" to be merged, so I can add them one by one to #19685 (or a follow up I'll be making shortly after).

@physicist87
Copy link
Contributor Author

@fwyzard
Dear andrea, should I answer the number of bins for each histograms in METMonitor.cc ?

@fwyzard
Copy link
Contributor

fwyzard commented Jul 13, 2017

yes, please: with the given python configuration, how many bins do we get, counting all the histograms ?

@davidlange6
Copy link
Contributor

davidlange6 commented Jul 13, 2017 via email

@fwyzard
Copy link
Contributor

fwyzard commented Jul 13, 2017

Mhm, a list of what ?

@physicist87
Copy link
Contributor Author

@davidlange6 @fwyzard
In this PR, I only updated Pure MET Trigger modifying METMonitor_cff.py .
The Trigger List is

HLT_L1ETMHadSeeds_v*
HLT_CaloMHT90_v*
HLT_CaloMET70_HBHECleaned_v*
HLT_CaloMET80_HBHECleaned_v*
HLT_CaloMET80_NotCleaned_v*
HLT_CaloMET90_HBHECleaned_v*
HLT_CaloMET90_NotCleaned_v*
HLT_CaloMET100_HBHECleaned_v*
HLT_CaloMET100_NotCleaned_v*
HLT_CaloMET110_NotCleaned_v*
HLT_CaloMET250_HBHECleaned_v*
HLT_CaloMET250_NotCleaned_v*
HLT_CaloMET300_HBHECleaned_v*
HLT_CaloMET350_HBHECleaned_v*
HLT_PFMET200_HBHE_BeamHaloCleaned_v*
HLT_PFMET200_HBHECleaned_v*
HLT_PFMET200_NotCleaned_v*
HLT_PFMET250_HBHECleaned_v*
HLT_PFMET300_HBHECleaned_v*
HLT_PFMETTypeOne200_HBHE_BeamHaloCleaned_v*

Total Triggers are 20.

And each trigger has
deltaphi_jet1jet2 ( nbins : 64, numerator & denominator ),
deltaphi_metjet1 ( nbins : 64, numerator & denominator ),
metPhi_( # of Bins : 64, numerator & denominator ),
metVsLS_ ( #of Bins :2500 , numerator & denominator ),
met_ (#of Bins : 200, numerator & denominator )
met_variable (# of bins : 25 ,numerator & denominator)
effic_met ( #of Bins : 200 ),
effic_metPhi ( #of Bins : 64 ),
effic_met_variable ( # of bins : 25 ),
effic_met_vs_LS ( #of Bins : 2500 ). So total the number of bins is 8627 for each trigger which I add.

Total of the number of bins : 8627 *20 = 172540.

@davidlange6 davidlange6 merged commit 2ce204c into cms-sw:master Jul 18, 2017
fwyzard added a commit to fwyzard/cmssw that referenced this pull request Jul 28, 2017
This PR includes a backport of the following PRs:
  - cms-sw#18172
  - cms-sw#18950
  - cms-sw#18959
  - cms-sw#18968
  - cms-sw#18971
  - cms-sw#19023
  - cms-sw#19046
  - cms-sw#19078
  - cms-sw#19119
  - cms-sw#19178
  - cms-sw#19290
  - cms-sw#19293
  - cms-sw#19294
  - cms-sw#19490
  - cms-sw#19499
  - cms-sw#19577
  - cms-sw#19585
  - cms-sw#19596
  - cms-sw#19599
  - cms-sw#19627
  - cms-sw#19689
  - cms-sw#19694
  - cms-sw#19703
  - cms-sw#19781
  - cms-sw#19794

plus the older ones, contained in DQMOffline/Trigger and HLTriggerOffline.

It synchronises with CMSSW_9_3_X
  - DQMServices/ClientConfig
  - DQMOffline/Configuration
  - DQMOffline/Trigger
  - HLTriggerOffline/Btag
  - HLTriggerOffline/Higgs
  - HLTriggerOffline/SUSYBSM
  - HLTriggerOffline/Tau
  - HLTriggerOffline/Top
fwyzard added a commit to fwyzard/cmssw that referenced this pull request Sep 3, 2017
This PR includes a backport of the following PRs:
  - cms-sw#18172
  - cms-sw#18950
  - cms-sw#18959
  - cms-sw#18968
  - cms-sw#18971
  - cms-sw#19023
  - cms-sw#19046
  - cms-sw#19078
  - cms-sw#19119
  - cms-sw#19178
  - cms-sw#19290
  - cms-sw#19293
  - cms-sw#19294
  - cms-sw#19490
  - cms-sw#19499
  - cms-sw#19577
  - cms-sw#19585
  - cms-sw#19596
  - cms-sw#19599
  - cms-sw#19627
  - cms-sw#19689
  - cms-sw#19694
  - cms-sw#19703
  - cms-sw#19781
  - cms-sw#19794

plus the older ones, contained in DQMOffline/Trigger and HLTriggerOffline.

It synchronises with CMSSW_9_3_X
  - DQMServices/ClientConfig
  - DQMOffline/Configuration
  - DQMOffline/Trigger
  - HLTriggerOffline/Btag
  - HLTriggerOffline/Higgs
  - HLTriggerOffline/SUSYBSM
  - HLTriggerOffline/Tau
  - HLTriggerOffline/Top
mtosi pushed a commit to mtosi/cmssw that referenced this pull request Oct 17, 2017
This PR includes a backport of the following PRs:
  - cms-sw#18172
  - cms-sw#18950
  - cms-sw#18959
  - cms-sw#18968
  - cms-sw#18971
  - cms-sw#19023
  - cms-sw#19046
  - cms-sw#19078
  - cms-sw#19119
  - cms-sw#19178
  - cms-sw#19290
  - cms-sw#19293
  - cms-sw#19294
  - cms-sw#19490
  - cms-sw#19499
  - cms-sw#19577
  - cms-sw#19585
  - cms-sw#19596
  - cms-sw#19599
  - cms-sw#19627
  - cms-sw#19689
  - cms-sw#19694
  - cms-sw#19703
  - cms-sw#19781
  - cms-sw#19794

plus the older ones, contained in DQMOffline/Trigger and HLTriggerOffline.

It synchronises with CMSSW_9_3_X
  - DQMServices/ClientConfig
  - DQMOffline/Configuration
  - DQMOffline/Trigger
  - HLTriggerOffline/Btag
  - HLTriggerOffline/Higgs
  - HLTriggerOffline/SUSYBSM
  - HLTriggerOffline/Tau
  - HLTriggerOffline/Top
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants