Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[10_6_X] Add AK8 ParticleNet mass regression model #45

Merged
merged 1 commit into from
May 6, 2021

Conversation

hqucms
Copy link
Contributor

@hqucms hqucms commented May 3, 2021

Backport of #44 for 10_6_X.

@cmsbuild
Copy link
Contributor

cmsbuild commented May 3, 2021

A new Pull Request was created by @hqucms (Huilin Qu) for branch CMSSW_10_6_X.

@perrotta, @smuzaffar, @iarspider, @mrodozov, @cmsbuild, @slava77, @jpata can you please review it and eventually sign? Thanks.
@ferencek, @JyothsnaKomaragiri, @emilbols, @andrzejnovak this is something you requested to watch as well.
cms-bot commands are listed here

@jpata
Copy link
Contributor

jpata commented May 5, 2021

+reconstruction

@cmsbuild
Copy link
Contributor

cmsbuild commented May 5, 2021

-1

Failed Tests: UnitTests RelVals RelVals-INPUT AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5b19da/14881/summary.html
COMMIT: 122a60b
CMSSW: CMSSW_12_0_X_2021-05-04-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/install.sh to create a dev area with all the needed externals and cmssw changes.

Found compilation warnings

Unit Tests

I found errors in the following unit tests:

---> test runtestPhysicsToolsPatAlgos had ERRORS
---> test runtestTqafTopEventProducers had ERRORS
---> test runtestTqafTopEventSelection had ERRORS
---> test runtestTqafTopHitFit had ERRORS
and more ...

RelVals

----- Begin Fatal Exception 05-May-2021 17:25:49 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named TTbar_8TeV_TuneCUETP8M1_cfi_GEN_SIM_RECOBEFMIX_DIGI_L1_DIGI2RAW_L1Reco_RECO_EI_VALIDATION_DQM.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file RecoBTag/Combined/data/TMVA_Btag_CsJets_PbPb2018_BDTG.weights.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-05-04-2300/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/runTheMatrix-results/5.1_TTbar+TTbarFS+HARVESTFS


At:
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Types.py(835): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(378): insertContentsInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(502): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1104): _insertManyInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1332): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 05-May-2021 17:25:49 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named ZEE_13TeV_TuneCUETP8M1_cfi_GEN_SIM_RECOBEFMIX_DIGI_L1_DIGI2RAW_L1Reco_RECO_EI_VALIDATION_DQM.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file RecoBTag/Combined/data/TMVA_Btag_CsJets_PbPb2018_BDTG.weights.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-05-04-2300/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/runTheMatrix-results/135.4_ZEE_13+ZEEFS_13+HARVESTUP15FS+MINIAODMCUP15FS


At:
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Types.py(835): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(378): insertContentsInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(502): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1104): _insertManyInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1332): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 05-May-2021 17:26:26 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named step2_PAT_DQM.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file RecoBTag/Combined/data/TMVA_Btag_CsJets_PbPb2018_BDTG.weights.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-05-04-2300/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/runTheMatrix-results/136.88811_RunJetHT2018D_reminiaodUL+RunJetHT2018D_reminiaodUL+REMINIAOD_data2018UL+HARVEST2018_REMINIAOD_data2018UL


At:
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Types.py(835): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(378): insertContentsInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(502): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1104): _insertManyInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1332): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
Expand to see more relval errors ...

RelVals-INPUT

  • 4.64.6_MinimumBias2010A+MinimumBias2010A+RECOSKIMALCA+HARVESTDR1/step2_MinimumBias2010A+MinimumBias2010A+RECOSKIMALCA+HARVESTDR1.log
  • 136.72411136.72411_RunJetHT2016B_reminiaodUL+RunJetHT2016B_reminiaodUL+REMINIAOD_data2016UL_HIPM+HARVESTDR2_REMINIAOD_data2016UL_HIPM/step2_RunJetHT2016B_reminiaodUL+RunJetHT2016B_reminiaodUL+REMINIAOD_data2016UL_HIPM+HARVESTDR2_REMINIAOD_data2016UL_HIPM.log
  • 136.76111136.76111_RunJetHT2016E_reminiaodUL+RunJetHT2016E_reminiaodUL+REMINIAOD_data2016UL_HIPM+HARVESTDR2_REMINIAOD_data2016UL_HIPM/step2_RunJetHT2016E_reminiaodUL+RunJetHT2016E_reminiaodUL+REMINIAOD_data2016UL_HIPM+HARVESTDR2_REMINIAOD_data2016UL_HIPM.log
Expand to see more relval errors ...

AddOn Tests

----- Begin Fatal Exception 05-May-2021 17:26:48 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named TTbar_8TeV_TuneCUETP8M1_cfi_GEN_SIM_RECOBEFMIX_DIGI_L1_DIGI2RAW_L1Reco_RECO_EI_VALIDATION.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file RecoBTag/Combined/data/TMVA_Btag_CsJets_PbPb2018_BDTG.weights.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-05-04-2300/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-addon/addOnTests/fastsim


At:
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Types.py(835): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(378): insertContentsInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(502): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1104): _insertManyInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1332): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 05-May-2021 17:26:09 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named /data/cmsbld/jenkins/workspace/ib-run-pr-addon/CMSSW_12_0_X_2021-05-04-2300/src/PhysicsTools/PatAlgos/test/IntegrationTest_cfg.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file RecoBTag/Combined/data/TMVA_Btag_CsJets_PbPb2018_BDTG.weights.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-05-04-2300/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-addon/addOnTests/pat1


At:
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Types.py(835): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(378): insertContentsInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(502): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1104): _insertManyInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1332): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 05-May-2021 17:26:48 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named TTbar_13TeV_TuneCUETP8M1_cfi_GEN_SIM_RECOBEFMIX_DIGI_L1_DIGI2RAW_L1Reco_RECO_EI_VALIDATION.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file RecoBTag/Combined/data/TMVA_Btag_CsJets_PbPb2018_BDTG.weights.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_0_X_2021-05-04-2300/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-addon/addOnTests/fastsim1


At:
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Types.py(835): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(378): insertContentsInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Mixins.py(502): insertInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1104): _insertManyInto
  /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14881/CMSSW_12_0_X_2021-05-04-2300/python/FWCore/ParameterSet/Config.py(1332): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
Expand to see more addon errors ...

@jpata
Copy link
Contributor

jpata commented May 6, 2021

This test does not look correct, it ran using 12_0_X. This PR was already tested in cms-sw/cmssw#33588 (comment).

@mrodozov
Copy link
Contributor

mrodozov commented May 6, 2021

please test for CMSSW_10_6_X

@mrodozov
Copy link
Contributor

mrodozov commented May 6, 2021

+externals

@mrodozov
Copy link
Contributor

mrodozov commented May 6, 2021

right. the test is fine

@cmsbuild
Copy link
Contributor

cmsbuild commented May 6, 2021

This pull request is fully signed and it will be integrated in one of the next CMSSW_10_6_X IBs after it passes the integration tests and once validation in the development release cycle CMSSW_12_0_X is complete. This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

@cmsbuild
Copy link
Contributor

cmsbuild commented May 6, 2021

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5b19da/14907/summary.html
COMMIT: 122a60b
CMSSW: CMSSW_10_6_X_2021-05-05-2300/slc7_amd64_gcc700
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-data/RecoBTag-Combined/45/14907/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

The workflows 140.53 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 1229 differences found in the comparisons
  • DQMHistoTests: Total files compared: 35
  • DQMHistoTests: Total histograms compared: 3215556
  • DQMHistoTests: Total failures: 2040
  • DQMHistoTests: Total nulls: 22
  • DQMHistoTests: Total successes: 3213160
  • DQMHistoTests: Total skipped: 334
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: -56.705 KiB( 34 files compared)
  • DQMHistoSizes: changed ( 140.53 ): -44.531 KiB Hcal/DigiRunHarvesting
  • DQMHistoSizes: changed ( 140.53 ): -10.938 KiB Info/EventInfo
  • DQMHistoSizes: changed ( 140.53 ): -1.172 KiB RPC/DCSInfo
  • DQMHistoSizes: changed ( 140.53 ): -0.064 KiB SiStrip/MechanicalView
  • Checked 143 log files, 29 edm output root files, 35 DQM output files
  • TriggerResults: no differences found

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants