Integration of constituent subtracted jets into heavy ion reconstruction #19537

mverwe · 2017-07-04T11:36:46Z

This PR replaces #18883

This PR implements Constituent Subtraction for underlying event removal for jets in heavy ion collisions.

Implementation was discussed in Reco and Analysis tools meeting:
https://indico.cern.ch/event/648883/

added possibility to VirtualJetProducer to write the jet and its constituents to the event record. This is relevant since the constituent subtraction is particle-by-particle subtraction and therefore produces a new set of PF candidates.
added the production of background estimates (HiFJRhoProducer) to the heavy ion reconstruction.
CS algo is run with the fastjet contrib package. pT and mass of ghosts is assigned in the CSJetProducer
The Cs jet production for R=0.3 and R=0.4 is added to the standard heavy ion workflow.

The PR was tested on wf 140.53 and 145

A report on this method in heavy ion collision at the JMAR meeting can be found here:
https://indico.cern.ch/event/502737/contributions/2012693/attachments/1237496/1817780/160302_ConstituentSubtraction.pdf

@rappoccio @mandrenguyen @cfmcginn @kurtejung @ahinzmann @knash

cmsbuild · 2017-07-04T11:37:05Z

A new Pull Request was created by @mverwe (Marta Verweij) for master.

It involves the following packages:

RecoHI/HiJetAlgos
RecoJets/JetProducers

@perrotta, @cmsbuild, @slava77, @davidlange6 can you please review it and eventually sign? Thanks.
@TaiSakuma, @jdolen, @ahinzmann, @schoef, @rappoccio, @jazzitup, @yslai, @nhanvtran, @yenjie, @gkasieczka, @kurtejung, @mariadalfonso, @mandrenguyen, @dgulhan, @seemasharmafnal, @yetkinyilmaz this is something you requested to watch as well.
@davidlange6 you are the release manager for this.

cms-bot commands are listed here

perrotta · 2017-07-04T11:55:11Z

please test

cmsbuild · 2017-07-04T11:55:27Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/21127/console Started: 2017/07/04 15:12

perrotta · 2017-07-04T13:06:20Z

@mverwe : could you please modify the title with something more descriptive? The one of the previous PR would be just fine, for example

cmsbuild · 2017-07-04T14:17:09Z

+1
Tested at: c68f60a
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19537/21127/summary.html

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
b1580cd
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19537/21127/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19537/21127/git-merge-result

cmsbuild · 2017-07-04T14:17:12Z

Comparison job queued.

cmsbuild · 2017-07-04T15:36:16Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19537/21127/summary.html

Comparison Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 22
DQMHistoTests: Total histograms compared: 1756063
DQMHistoTests: Total failures: 88
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 1755809
DQMHistoTests: Total skipped: 166
DQMHistoTests: Total Missing objects: 0
Checked 90 log files, 14 edm output root files, 22 DQM output files

perrotta · 2017-07-17T08:15:11Z

Timing: on HI workflow 140.53 (2011 PbPb MinBias data) the time added by the new modules is
added +0.00% 0.00 ms/ev -> 0.23 ms/ev hiFJRhoProducer
added +1.29% 0.00 ms/ev -> 186.15 ms/ev akCs4PFJets
added +0.89% 0.00 ms/ev -> 127.88 ms/ev akCs3PFJets
added +0.41% 0.00 ms/ev -> 59.11 ms/ev kt4PFJetsForRho
There are no significant differences in timing of the other modules

perrotta · 2017-07-17T08:18:46Z

Overall event size increases by (+0.86%) in that 140.53 worklfow, where the details for the newly added modules are below:

recoPFCandidates_akCs3PFJets_pfParticlesCs_reRECO. 85157.5 5107.39
recoPFCandidates_akCs4PFJets_pfParticlesCs_reRECO. 65386.9 3969.41
recoPFJets_akCs3PFJets__reRECO. 25833.8 4435.81
recoPFJets_akCs4PFJets__reRECO. 16071.4 2718.56
recoPFJets_kt4PFJetsForRho__reRECO. 61713.4 13354.1
doubles_hiFJRhoProducer_etaJets_reRECO. 1266.47 745.571
doubles_hiFJRhoProducer_ptJets_reRECO. 1266.04 704.943
doubles_hiFJRhoProducer_areaJets_reRECO. 1266.9 365.486
doubles_hiFJRhoProducer_mapToRhoM_reRECO. 131.671 122.786
doubles_hiFJRhoProducer_mapToRho_reRECO. 131.243 105.471
doubles_hiFJRhoProducer_mapEtaEdges_reRECO. 140.529 73.6143
doubles_kt4PFJetsForRho_sigmas_reRECO. 162.386 138.457
doubles_kt4PFJetsForRho_rhos_reRECO. 161.529 137.286
double_kt4PFJetsForRho_sigma_reRECO. 65.9857 60.6857
double_kt4PFJetsForRho_rho_reRECO. 65.1286 59.8286
doubles_akCs3PFJets_sigmas_reRECO. 72.6714 65.0286
doubles_akCs4PFJets_sigmas_reRECO. 72.6714 65.0286
doubles_akCs3PFJets_rhos_reRECO. 71.8143 64.1714
doubles_akCs4PFJets_rhos_reRECO. 71.8143 64.1714
double_akCs3PFJets_sigma_reRECO. 64.2714 58.9714
double_akCs4PFJets_sigma_reRECO. 64.2714 58.9714
double_akCs4PFJets_rho_reRECO. 63.4143 58.1143
double_akCs3PFJets_rho_reRECO. 63.4143 58.1143

In the workflow 150.1 (QCD_Pt_80_120, i.e. more jetty) this PR adds 2.7% to the overall event size (step3)

perrotta · 2017-07-17T08:19:40Z

please test
(the results of the tests seems to be missing...)

cmsbuild · 2017-07-17T08:19:59Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/21511/console Started: 2017/07/17 10:21

perrotta · 2017-07-19T09:25:39Z

abort test

cmsbuild · 2017-07-19T09:25:56Z

Jenkins tests are aborted.

cmsbuild · 2017-07-19T09:34:37Z

Pull request #19537 was updated. @perrotta, @cmsbuild, @slava77, @davidlange6 can you please check and sign again.

perrotta · 2017-07-19T09:38:12Z

please test

cmsbuild · 2017-07-19T09:38:26Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/21608/console Started: 2017/07/19 11:39
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/21612/console Started: 2017/07/19 12:25

cmsbuild · 2017-07-19T11:46:23Z

+1
Tested at: 1136e40
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19537/21612/summary.html

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
504de00
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19537/21612/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19537/21612/git-merge-result

cmsbuild · 2017-07-19T11:46:26Z

Comparison job queued.

cmsbuild · 2017-07-19T21:15:31Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19537/21612/summary.html

Comparison Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 23
DQMHistoTests: Total histograms compared: 2293998
DQMHistoTests: Total failures: 44342
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2249490
DQMHistoTests: Total skipped: 166
DQMHistoTests: Total Missing objects: 0
Checked 93 log files, 14 edm output root files, 23 DQM output files

perrotta · 2017-07-20T07:41:09Z

+1
Same as #19537 (comment)
Recent fixes and adjustments are fine with reco (once again...)

cmsbuild · 2017-07-20T07:41:28Z

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request requires discussion in the ORP meeting before it's merged. @davidlange6, @smuzaffar

davidlange6 · 2017-07-20T09:30:25Z

+1

cmsbuild added this to the CMSSW_9_3_X milestone Jul 4, 2017

cmsbuild added comparison-pending orp-pending pending-signatures reconstruction-pending tests-pending labels Jul 4, 2017

mverwe mentioned this pull request Jul 4, 2017

Integration of constituent subtracted jets into heavy ion reconstruction #18883

Closed

cmsbuild added tests-started and removed tests-pending labels Jul 4, 2017

mverwe changed the title ~~Cs integration june20~~ Integration of constituent subtracted jets into heavy ion reconstruction Jul 4, 2017

cmsbuild added tests-approved and removed tests-started labels Jul 4, 2017

cmsbuild added comparison-available and removed comparison-pending labels Jul 4, 2017

cmsbuild added comparison-pending tests-pending and removed comparison-available tests-approved labels Jul 17, 2017

cmsbuild removed the tests-pending label Jul 17, 2017

cmsbuild added tests-pending and removed tests-started labels Jul 19, 2017

remove commented line

1136e40

cmsbuild added tests-started and removed tests-pending labels Jul 19, 2017

cmsbuild added tests-approved and removed tests-started labels Jul 19, 2017

cmsbuild added comparison-available and removed comparison-pending labels Jul 19, 2017

cmsbuild added fully-signed reconstruction-approved and removed pending-signatures reconstruction-pending labels Jul 20, 2017

cmsbuild added orp-approved and removed orp-pending labels Jul 20, 2017

cmsbuild merged commit d4567c9 into cms-sw:master Jul 20, 2017

kurtejung mentioned this pull request Jul 27, 2017

updating HI Jet DQM to include CS jets and removing VS jets #19943

Merged

mandrenguyen mentioned this pull request Sep 27, 2017

Items needed for XeXe run processing with 92X #20654

Closed

mandrenguyen added a commit to mandrenguyen/cmssw that referenced this pull request Sep 27, 2017

Backport of cms-sw#19537 to 92X

129ae47

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Integration of constituent subtracted jets into heavy ion reconstruction #19537

Integration of constituent subtracted jets into heavy ion reconstruction #19537

mverwe commented Jul 4, 2017

cmsbuild commented Jul 4, 2017

perrotta commented Jul 4, 2017

cmsbuild commented Jul 4, 2017 •

edited

perrotta commented Jul 4, 2017

cmsbuild commented Jul 4, 2017

cmsbuild commented Jul 4, 2017

cmsbuild commented Jul 4, 2017

perrotta commented Jul 17, 2017 •

edited

perrotta commented Jul 17, 2017 •

edited

perrotta commented Jul 17, 2017

cmsbuild commented Jul 17, 2017 •

edited

perrotta commented Jul 19, 2017

cmsbuild commented Jul 19, 2017

cmsbuild commented Jul 19, 2017

perrotta commented Jul 19, 2017

cmsbuild commented Jul 19, 2017 •

edited

cmsbuild commented Jul 19, 2017

cmsbuild commented Jul 19, 2017

cmsbuild commented Jul 19, 2017

perrotta commented Jul 20, 2017

cmsbuild commented Jul 20, 2017

davidlange6 commented Jul 20, 2017

Integration of constituent subtracted jets into heavy ion reconstruction #19537

Integration of constituent subtracted jets into heavy ion reconstruction #19537

Conversation

mverwe commented Jul 4, 2017

cmsbuild commented Jul 4, 2017

perrotta commented Jul 4, 2017

cmsbuild commented Jul 4, 2017 • edited

perrotta commented Jul 4, 2017

cmsbuild commented Jul 4, 2017

cmsbuild commented Jul 4, 2017

cmsbuild commented Jul 4, 2017

perrotta commented Jul 17, 2017 • edited

perrotta commented Jul 17, 2017 • edited

perrotta commented Jul 17, 2017

cmsbuild commented Jul 17, 2017 • edited

perrotta commented Jul 19, 2017

cmsbuild commented Jul 19, 2017

cmsbuild commented Jul 19, 2017

perrotta commented Jul 19, 2017

cmsbuild commented Jul 19, 2017 • edited

cmsbuild commented Jul 19, 2017

cmsbuild commented Jul 19, 2017

cmsbuild commented Jul 19, 2017

perrotta commented Jul 20, 2017

cmsbuild commented Jul 20, 2017

davidlange6 commented Jul 20, 2017

cmsbuild commented Jul 4, 2017 •

edited

perrotta commented Jul 17, 2017 •

edited

perrotta commented Jul 17, 2017 •

edited

cmsbuild commented Jul 17, 2017 •

edited

cmsbuild commented Jul 19, 2017 •

edited