Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

increase of pT threshold for photons to be considered for tau reconstruction and ID #20900

Merged
merged 2 commits into from Oct 17, 2017

Conversation

roger-wolf
Copy link
Contributor

Hi Slava, Andrea,

this is a PR to mitigate discrepancies in the MC description of PF photons used for tau reconstruction and ID. To mitigate this issue the pT for PF photons to be considered for tau reconstruction and ID is raised from 0.5 to 1 GeV. The implementation and validation has been provided by @mbluj. I post his initial PR description below (*). These are pure changes on configuration level. We do expect changed in the validation plots (see below). Usual unit tests perform fine. We would like to have this still being part of the upcoming 94X production release!

Thanx a lot!

Cheers,
Roger

(*)
As title of the PR says, this is a set of modification of python cfi/cff files to increase Et threshold of PF-photons used in tau reconstruction and identification from 0.5 to 1GeV. The modification is expected to have the following effects:

  • momentum (and thus Pt) of reconstructed taus will be slightly smaller,
  • some, but rather small, migration from decay modes with pi0's to decay modes without pi0's (1p+pi0->1p and 3p+pi0->3p)
  • smaller values of photon related isolation sums, etc.

Expected changes are summarized in slides which can be found here:

@cmsbuild cmsbuild changed the base branch from CMSSW_9_4_X to master October 11, 2017 19:44
@cmsbuild
Copy link
Contributor

@roger-wolf, CMSSW_9_4_X branch is closed for direct updates. cms-bot is going to move this PR to master branch.
In future, please use cmssw master branch to submit your changes.

@cmsbuild
Copy link
Contributor

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/PR-20900/1411

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @roger-wolf (Roger Wolf) for master.

It involves the following packages:

RecoTauTag/Configuration
RecoTauTag/RecoTau

@perrotta, @cmsbuild, @slava77 can you please review it and eventually sign? Thanks.
@davidlange6, @slava77 you are the release manager for this.

cms-bot commands are listed here

@@ -80,12 +80,12 @@
## ByMediumIsolation
hpsPFTauDiscriminationByMediumIsolation = hpsPFTauDiscriminationByLooseIsolation.clone()
hpsPFTauDiscriminationByMediumIsolation.qualityCuts.isolationQualityCuts.minTrackPt = 0.8
hpsPFTauDiscriminationByMediumIsolation.qualityCuts.isolationQualityCuts.minGammaEt = 0.8
hpsPFTauDiscriminationByMediumIsolation.qualityCuts.isolationQualityCuts.minGammaEt = 1.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this change in threshold is applied here for all tau reconstruction: run1, phase-2, 2015-16, and the current pp of 2017.
Is this the intention or are you trying to mitigate the effects of the ECAL ZS/SR changes special for 2017 and this applies only to 2017?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hello,
we are aware that it is applied for tau reconstruction for all Eras; a couple words of explanation to make it more clear:

  1. The change has nothing to do with ECAL ZS/SR changes - it was checked with dedicated samples that the issue observed by Tau POG with low-Pt photons is not cured by the ZS/SR fix proposed by ECAL DPG.
  2. The issue is related to Run-2 data, i.e. was not observed during Run-1, but we suppose that CMSSW from 94X and newer release series will not be used to re-reconstruct Run-1 data. However, if such a re-reco is not impossible we can introduce a specialization for Run-1 - please let us know.
  3. It is intended that it consistently modifies reconstruction of Run-2 data. However, we are not aware of any plan of re-reconstruction of 2015 data with the 94X+ release series. What concerns 2016 80XLegacy re-miniAOD with 94X it is in fact foreseen that the re-miniAOD will consists of re-reco of taus with 2017-like setup.
  4. Taus for phase-2: it is fine that this modification is propagated there as we believe that it will help at high PU. However, tau reco for phase-2 is still worked on (for instance in the context of HGCAL and Physics TDRs) and additional changes can be expected.

@slava77
Copy link
Contributor

slava77 commented Oct 11, 2017

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 11, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/23696/console Started: 2017/10/11 22:38

@cmsbuild
Copy link
Contributor

-1

Tested at: dfa9787

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
dfa9787
e7a2ae1
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20900/23696/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20900/23696/git-merge-result

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20900/23696/summary.html

I found follow errors while testing this PR

Failed tests: RelVals

  • RelVals:

When I ran the RelVals I found an error in the following worklfows:
1000.0 step3

runTheMatrix-results/1000.0_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT/step3_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT.log

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
dfa9787
e7a2ae1
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20900/23696/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20900/23696/git-merge-result

@cmsbuild
Copy link
Contributor

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

@perrotta
Copy link
Contributor

please test
(the latest IB, CMSSW_9_4_X_2017-10-11-2300, should finally contain the fix for the issue in the RelVal wf 1000)

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 12, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/23708/console Started: 2017/10/12 09:53

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@slava77
Copy link
Contributor

slava77 commented Oct 12, 2017 via email

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20900/23708/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 402 differences found in the comparisons
  • DQMHistoTests: Total files compared: 26
  • DQMHistoTests: Total histograms compared: 2767051
  • DQMHistoTests: Total failures: 16189
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2750691
  • DQMHistoTests: Total skipped: 171
  • DQMHistoTests: Total Missing objects: 0
  • Checked 107 log files, 10 edm output root files, 26 DQM output files

@roger-wolf
Copy link
Contributor Author

Dear all,

from a coarse inspection of the millions of comparison plots I see differences which look as expected.

Since both the decay mode reconstruction as well as the tauID are affected by the increase of the photon pT none of the plots is expected to look identical to the reference. On a representative Higgs and ttbar sample I see less photons for the isolation sum, this is expected. Also a slightly better energy resolution of the reconstructed taus has been reported by Michal.

I know that @mbluj is planning to have a look into the comparisons as well, but he cannot promise to do so before late during today. Also @steggema and @isobelojalvo might want to comment on the output.

Cheers,
Roger

@isobelojalvo
Copy link
Contributor

Dear Roger, All,
Thank you for getting this integrated so quickly. We do expect minor changes in the performance for the 1 prong and 1prong pi0 taus and from the plots I have seen they are following what has been shown in the offline studies. Perhaps @steggema has a chance to take a look as well.
Cheers,
Isobel

@steggema
Copy link
Contributor

steggema commented Oct 12, 2017 via email

@mbluj
Copy link
Contributor

mbluj commented Oct 13, 2017 via email

@perrotta
Copy link
Contributor

From (e.g.) the SinglePh2017B wf run during the jenkins tests the effect of the modified cuts is clearly visible:

image

image

Pizeros are mostly removed in the barrel:

image

All the discriminators by isolation are more peaked at one (as there are less photon around in the isolation cone):

image

@perrotta
Copy link
Contributor

+1

  • Incresing the minim pt of the photons admitted in tau algorithms allows mitigating the disagreement between 2016 data and simulation observed for PF-photons with pT below ~1 GeV
  • The effects of the new cuts have been scrutinized by the tau group, which looks happy of the results obtained
  • Jenkins test results are in line with what expected by the tau POG
  • Some marginal effect on MET can be expected, and also visible in the jenkins tests, e.g. MET uncertainty in miniAOD from wf 10024 TTBar:
    image

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar (and backports should be raised in the release meeting by the corresponding L2)

@davidlange6
Copy link
Contributor

merge

@cmsbuild cmsbuild merged commit 1598183 into cms-sw:master Oct 17, 2017
@roger-wolf roger-wolf deleted the CMSSW_9_4_X_tau-pog_photonPt branch November 17, 2017 11:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants