Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run3 ele ID is added to the cleaned 126 nanoAOD electron module + DQM (Run3 EffArea is applied only to the EGamma supported variables) #40045

Merged
merged 11 commits into from Nov 18, 2022

Conversation

rgoldouz
Copy link
Contributor

Hello Experts,

Following my previous PR,
#39839
I have added new run3 electron cutbased ID to the electron module.
The code works like the following,
-Run2ID and Run3ID should be properly saved in the default cutbased variable;
-For Run3 samples, Run2IDs and Iso variables are also added as a backup solution.
-For Run2, only run2ID is saved as default and no extra variable related to the run3 is saved.

Please let me know your comments.

Thanks,
Reza

@swagata87 @a-kapoor @DebabrataBhowmik @swertz

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40045/33001

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @rgoldouz (Reza Goldouzian) for master.

It involves the following packages:

  • PhysicsTools/NanoAOD (xpog)
  • PhysicsTools/PatAlgos (xpog, reconstruction)
  • RecoEgamma/ElectronIdentification (reconstruction)

@cmsbuild, @mandrenguyen, @clacaputo, @swertz, @vlimant can you please review it and eventually sign? Thanks.
@rappoccio, @gouskos, @jainshilpi, @hatakeyamak, @emilbols, @Sam-Harper, @mbluj, @demuller, @varuns23, @seemasharmafnal, @mmarionncern, @jdolen, @ahinzmann, @lgray, @missirol, @Prasant1993, @azotz, @a-kapoor, @jdamgov, @nhanvtran, @gkasieczka, @schoef, @andrzejnovak, @AlexDeMoor, @AnnikaStein, @valsdav, @JyothsnaKomaragiri, @sobhatta, @afiqaize, @gpetruc, @wrtabb, @mariadalfonso, @sameasy, @ram1123 this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

@swertz
Copy link
Contributor

swertz commented Nov 10, 2022

Thanks @rgoldouz , on first sight things look good, but can I just ask you to add the new variables to the DQM before I trigger the tests? https://github.com/cms-sw/cmssw/blob/master/PhysicsTools/NanoAOD/python/nanoDQM_cfi.py

@swertz
Copy link
Contributor

swertz commented Nov 10, 2022

enable nano

@swagata87
Copy link
Contributor

type egamma

@rgoldouz
Copy link
Contributor Author

Hi @swertz ,

I did not add these new Fall17 variables to the DQM code since they are absent when running on run2 samples. Is it OK to add them as default? if no, how should I add them?

Thanks,
Reza

@swertz
Copy link
Contributor

swertz commented Nov 11, 2022

I did not add these new Fall17 variables to the DQM code since they are absent when running on run2 samples. Is it OK to add them as default? if no, how should I add them?

You can customize the DQM content here: https://github.com/cms-sw/cmssw/blob/master/PhysicsTools/NanoAOD/python/nanoDQM_cff.py
E.g. adding the new variables in the DQM by default but removing them for Run2 by doing sth like

_Electron_Run2_plots = cms.VPSet()
for plot in nanoDQM.vplots.Electron.plots:
    if plot.name.value() != ...:
        _Electron_Run2_plots.append(plot)
run2_nanoAOD_ANY.toModify(nanoDQM.vplots.Electron, plots = _Electron_Run2_plots)

@rgoldouz
Copy link
Contributor Author

Thanks @swertz ,

I made a new commit including the DQM code and small modification to the new variable names.

Thanks,
Reza

@cmsbuild
Copy link
Contributor

Pull request #40045 was updated. @cmsbuild, @mandrenguyen, @clacaputo, @swertz, @vlimant can you please check and sign again.

@swertz
Copy link
Contributor

swertz commented Nov 16, 2022

please test

@mandrenguyen
Copy link
Contributor

@rgoldouz would you mind fixing the PR title, which got a bit mangled, and making it a bit more descriptive?

@cmsbuild
Copy link
Contributor

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-bb94d5/29050/summary.html
COMMIT: 9585b7d
CMSSW: CMSSW_12_6_X_2022-11-16-1100/el8_amd64_gcc10
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/40045/29050/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

The relvals timed out after 4 hours.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 614 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3417074
  • DQMHistoTests: Total failures: 59
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3416993
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 8.411999999999999 KiB( 47 files compared)
  • DQMHistoSizes: changed ( 11634.0,... ): 1.055 KiB Physics/NanoAODDQM
  • DQMHistoSizes: changed ( 13234.0,... ): 0.694 KiB Physics/NanoAODDQM
  • Checked 206 log files, 48 edm output root files, 48 DQM output files
  • TriggerResults: no differences found

NANO Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.311_mc106Xul17v2+TTbarMINIAOD10.6_UL17v2+NANO_mc10.6ul17v2+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.312_mc106Xul17v2+TTbarMINIAOD10.6_UL18v2+NANO_mc10.6ul18v2+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.31_mc106Xul17v2+TTbarMINIAOD10.6_UL16v2+NANO_mc10.6ul16v2+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.331_data106Xul17v2+MuonEG2017MINIAOD10.6v2+NANO_data10.6ul17v2+HRV_NANO_data
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.332_data106Xul18v2+MuonEG2018MINIAOD10.6v2+NANO_data10.6ul18v2+HRV_NANO_data
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.33_data106Xul16v2+MuonEG2016MINIAOD10.6v2+NANO_data10.6ul16v2+HRV_NANO_data
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.401_mc122Xrun3+TTbarMINIAOD12.2+NANO_mc12.2+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.4_mc122Xrun3_v10+TTbarMINIAOD12.2+NANO_mc12.2_v10+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.501_mc124Xrun3+TTbarMINIAOD12.4+NANO_mc12.4+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.511_data124Xrun3+MuonEG2022MINIAOD12.4+NANO_data12.4+HRV_NANO_data
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.51_data124Xrun3_v10+MuonEG2022MINIAOD12.4+NANO_data12.4_v10+HRV_NANO_data
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.5_mc124Xrun3_v10+TTbarMINIAOD12.4+NANO_mc12.4_v10+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.6_mc126X_v10+TTBarMINIAOD12.6+NANO_mc12.6_v10+HRV_NANO_mc

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 15
  • DQMHistoTests: Total histograms compared: 14740
  • DQMHistoTests: Total failures: 151
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 14589
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 6.9959999999999996 KiB( 14 files compared)
  • DQMHistoSizes: changed ( 2500.401,... ): 1.055 KiB Physics/NanoAODDQM
  • DQMHistoSizes: changed ( 2500.511,... ): 0.694 KiB Physics/NanoAODDQM
  • Checked 31 log files, 0 edm output root files, 15 DQM output files

Nano size comparison Summary:

Sample kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
2500.31 2.204 2.204 0.000 ( +0.0% ) 9.18 9.06 +1.3% 1.544 1.471
2500.311 2.324 2.324 0.000 ( +0.0% ) 8.88 8.81 +0.8% 1.913 1.836
2500.312 2.276 2.276 0.000 ( +0.0% ) 8.94 8.96 -0.3% 1.906 1.835
2500.33 1.099 1.099 0.000 ( +0.0% ) 21.38 21.55 -0.8% 1.651 1.645
2500.331 1.396 1.396 0.000 ( +0.0% ) 15.76 15.72 +0.2% 1.810 1.807
2500.332 1.328 1.328 0.000 ( +0.0% ) 17.32 17.61 -1.6% 1.755 1.749
2500.4 2.115 2.115 0.000 ( +0.0% ) 9.77 9.49 +3.0% 1.478 1.400
2500.401 2.126 2.113 0.012 ( +0.6% ) 9.83 9.86 -0.3% 1.264 1.181
2500.5 0.302 0.302 0.000 ( +0.0% ) 50.15 49.88 +0.5% 1.224 1.148
2500.501 0.303 0.302 0.000 ( +0.1% ) 49.64 50.15 -1.0% 1.206 1.128
2500.51 1.087 1.087 0.000 ( +0.0% ) 28.06 27.83 +0.8% 1.477 1.398
2500.511 1.102 1.092 0.010 ( +0.9% ) 27.68 27.85 -0.6% 1.477 1.399
2500.6 1.418 1.418 0.000 ( +0.0% ) 22.83 22.97 -0.6% 1.183 1.102
2500.601 1.433 1.422 0.012 ( +0.8% ) 22.92 22.93 -0.0% 1.196 1.107

@rgoldouz rgoldouz changed the title Run3 ele i dfor126 Run3 ele ID is added to the cleaned 126 nanoAOD electron module + DQM (Run3 EffArea is applied only to the EGamma supported variables) Nov 17, 2022
@swertz
Copy link
Contributor

swertz commented Nov 17, 2022

please test

Retrying because of timeouts

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-bb94d5/29072/summary.html
COMMIT: 9585b7d
CMSSW: CMSSW_12_6_X_2022-11-16-1100/el8_amd64_gcc10
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/40045/29072/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 622 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3417074
  • DQMHistoTests: Total failures: 65
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3416987
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 8.411999999999999 KiB( 47 files compared)
  • DQMHistoSizes: changed ( 11634.0,... ): 1.055 KiB Physics/NanoAODDQM
  • DQMHistoSizes: changed ( 13234.0,... ): 0.694 KiB Physics/NanoAODDQM
  • Checked 206 log files, 48 edm output root files, 48 DQM output files
  • TriggerResults: no differences found

NANO Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.311_mc106Xul17v2+TTbarMINIAOD10.6_UL17v2+NANO_mc10.6ul17v2+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.312_mc106Xul17v2+TTbarMINIAOD10.6_UL18v2+NANO_mc10.6ul18v2+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.31_mc106Xul17v2+TTbarMINIAOD10.6_UL16v2+NANO_mc10.6ul16v2+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.331_data106Xul17v2+MuonEG2017MINIAOD10.6v2+NANO_data10.6ul17v2+HRV_NANO_data
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.332_data106Xul18v2+MuonEG2018MINIAOD10.6v2+NANO_data10.6ul18v2+HRV_NANO_data
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.33_data106Xul16v2+MuonEG2016MINIAOD10.6v2+NANO_data10.6ul16v2+HRV_NANO_data
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.401_mc122Xrun3+TTbarMINIAOD12.2+NANO_mc12.2+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.4_mc122Xrun3_v10+TTbarMINIAOD12.2+NANO_mc12.2_v10+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.501_mc124Xrun3+TTbarMINIAOD12.4+NANO_mc12.4+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.511_data124Xrun3+MuonEG2022MINIAOD12.4+NANO_data12.4+HRV_NANO_data
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.51_data124Xrun3_v10+MuonEG2022MINIAOD12.4+NANO_data12.4_v10+HRV_NANO_data
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.5_mc124Xrun3_v10+TTbarMINIAOD12.4+NANO_mc12.4_v10+HRV_NANO_mc
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-bb94d5/2500.6_mc126X_v10+TTBarMINIAOD12.6+NANO_mc12.6_v10+HRV_NANO_mc

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 15
  • DQMHistoTests: Total histograms compared: 14740
  • DQMHistoTests: Total failures: 151
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 14589
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 6.9959999999999996 KiB( 14 files compared)
  • DQMHistoSizes: changed ( 2500.401,... ): 1.055 KiB Physics/NanoAODDQM
  • DQMHistoSizes: changed ( 2500.511,... ): 0.694 KiB Physics/NanoAODDQM
  • Checked 31 log files, 0 edm output root files, 15 DQM output files

Nano size comparison Summary:

Sample kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
2500.31 2.204 2.204 0.000 ( +0.0% ) 9.34 9.06 +3.1% 1.543 1.471
2500.311 2.324 2.324 0.000 ( +0.0% ) 8.88 8.81 +0.8% 1.916 1.836
2500.312 2.276 2.276 0.000 ( +0.0% ) 8.98 8.96 +0.2% 1.907 1.835
2500.33 1.099 1.099 0.000 ( +0.0% ) 21.06 21.55 -2.3% 1.647 1.645
2500.331 1.396 1.396 0.000 ( +0.0% ) 15.80 15.72 +0.5% 1.808 1.807
2500.332 1.328 1.328 0.000 ( +0.0% ) 17.68 17.61 +0.4% 1.754 1.749
2500.4 2.115 2.115 0.000 ( +0.0% ) 9.85 9.49 +3.9% 1.488 1.400
2500.401 2.126 2.113 0.012 ( +0.6% ) 9.84 9.86 -0.2% 1.262 1.181
2500.5 0.302 0.302 0.000 ( +0.0% ) 50.48 49.88 +1.2% 1.221 1.148
2500.501 0.303 0.302 0.000 ( +0.1% ) 50.34 50.15 +0.4% 1.211 1.128
2500.51 1.087 1.087 0.000 ( +0.0% ) 28.29 27.83 +1.6% 1.478 1.398
2500.511 1.102 1.092 0.010 ( +0.9% ) 28.10 27.85 +0.9% 1.476 1.399
2500.6 1.418 1.418 0.000 ( +0.0% ) 22.99 22.97 +0.1% 1.191 1.102
2500.601 1.433 1.422 0.012 ( +0.8% ) 22.97 22.93 +0.2% 1.190 1.107

@swertz
Copy link
Contributor

swertz commented Nov 17, 2022

+1

  • Run2 and nanoV10 workflows are not affected
  • Run3 workflows have expected differences in electron cutBased and pfRelIso03_all variables; the fallback Fall17V2 variables are present

As previously discussed this is not consistent with what is being done for Run3 photon IDs in nano, but this can be resolved later.

@mandrenguyen
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

@rappoccio
Copy link
Contributor

+1

Run 3 nano changes expected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants