optics for Run3 (prelim.) #5

michael-pitt · 2021-08-30T15:37:49Z

A preliminary version of optical function using Run3 settings, produced from MAD-X source files available in /afs/cern.ch/eng/lhc/optics/runIII/RunIII_dev/2021_V5/PROTON/

cmsbuild · 2021-08-30T15:38:08Z

A new Pull Request was created by @michael-pitt (Michael Pitt) for branch master.

@smuzaffar, @yuanchao, @malbouis, @mrodozov, @iarspider, @cmsbuild, @tlampen, @pohsun, @francescobrivio, @tvami can you please review it and eventually sign? Thanks.
@fabferro, @jan-kaspar, @mmusich, @tocheng this is something you requested to watch as well.
@perrotta, @dpiparo, @qliphy you are the release manager for this.
cms-bot commands are listed here

jan-kaspar · 2021-09-07T12:24:38Z

The new data will be consumed in CMSSW with cms-sw/cmssw#35177.

tvami · 2021-09-07T13:09:22Z

@cmsbuild please test

cmsbuild · 2021-09-07T14:30:53Z

-1

Failed Tests: RelVals AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a7fd33/18359/summary.html
COMMIT: 9c17eb9
CMSSW: CMSSW_12_1_X_2021-09-06-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

312.0

----- Begin Fatal Exception 07-Sep-2021 15:49:55 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named Pyquen_ZeemumuJets_pt10_2760GeV_cfi_GEN_SIM_PU.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file SimG4CMS/Calo/data/HFShowerLibrary_run3_v5.root anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/runTheMatrix-results/312.0_Pyquen_ZeemumuJets_pt10_2760GeV_2021+Pyquen_ZeemumuJets_pt10_2760GeV_2021+DIGIHI2021MIX+RECOHI2021MIX+HARVESTHI2021PPRECO


At:
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(840): insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Mixins.py(377): insertContentsInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(925): insertContentsInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(918): insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Config.py(1092): _insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Config.py(1306): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------

11634.0

----- Begin Fatal Exception 07-Sep-2021 15:56:32 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named TTbar_14TeV_TuneCP5_cfi_GEN_SIM.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file SimG4CMS/Calo/data/HFShowerLibrary_run3_v5.root anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/runTheMatrix-results/11634.0_TTbar_14TeV+2021+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST+ALCA


At:
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(840): insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Mixins.py(377): insertContentsInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(925): insertContentsInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(918): insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Config.py(1092): _insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Config.py(1306): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------

11634.911

----- Begin Fatal Exception 07-Sep-2021 15:56:42 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named TTbar_14TeV_TuneCP5_cfi_GEN_SIM.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file SimG4CMS/Calo/data/HFShowerLibrary_run3_v5.root anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/runTheMatrix-results/11634.911_TTbar_14TeV+2021_DD4hep+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST+ALCA


At:
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(840): insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Mixins.py(377): insertContentsInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(925): insertContentsInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(918): insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Config.py(1092): _insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Config.py(1306): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

AddOn Tests

hlt_mc_GRun

----- Begin Fatal Exception 07-Sep-2021 15:43:25 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named TTbar_Tauola_13TeV_TuneCUETP8M1_cfi_GEN_SIM_DIGI_L1_DIGI2RAW.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file SimG4CMS/Calo/data/HFShowerLibrary_run3_v5.root anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18359/CMSSW_12_1_X_2021-09-06-2300/external/slc7_amd64_gcc900/data:/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/src
Current directory is: /build/cmsbld/jenkins/workspace/ib-run-pr-addon/addOnTests/hlt_mc_GRun


At:
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(840): insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Mixins.py(377): insertContentsInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(925): insertContentsInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Types.py(918): insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Config.py(1092): _insertInto
  /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_1_X_2021-09-06-2300/python/FWCore/ParameterSet/Config.py(1306): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------

hlt_mc_GRun

----- Begin Fatal Exception 07-Sep-2021 15:43:50 CEST-----------------------
An exception of category 'FileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling File::sysopen()
Exception Message:
Failed to open the file 'RelVal_Raw_GRun_MC.root'
   Additional Info:
      [a] Input file file:RelVal_Raw_GRun_MC.root could not be opened.
      [b] open() failed with system error 'No such file or directory' (error code 2)
----- End Fatal Exception -------------------------------------------------

hlt_mc_GRun

----- Begin Fatal Exception 07-Sep-2021 15:45:05 CEST-----------------------
An exception of category 'FileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling File::sysopen()
Exception Message:
Failed to open the file 'RelVal_Raw_GRun_MC.root'
   Additional Info:
      [a] Input file file:RelVal_Raw_GRun_MC.root could not be opened.
      [b] open() failed with system error 'No such file or directory' (error code 2)
----- End Fatal Exception -------------------------------------------------

Expand to see more addon errors ...

smuzaffar · 2021-09-07T16:54:17Z

please test
these are new files so basically nothing to test here. The actual tests are running via cms-sw/cmssw#35177

cmsbuild · 2021-09-07T20:14:23Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a7fd33/18366/summary.html
COMMIT: 9c17eb9
CMSSW: CMSSW_12_1_X_2021-09-07-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-data/CalibPPS-ESProducers/5/18366/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 39
DQMHistoTests: Total histograms compared: 3001001
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3000979
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 38 files compared)
Checked 165 log files, 37 edm output root files, 39 DQM output files
TriggerResults: no differences found

tvami · 2021-09-07T20:16:16Z

+alca

these are the input files needed for PPS: preparation for 2022 conditions cms-sw/cmssw#35177

mrodozov · 2021-09-08T09:55:57Z

+externals

cmsbuild · 2021-09-08T09:56:18Z

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

optics for Run3 (prelim.)

9c17eb9

cmsbuild added alca-pending externals-pending orp-pending pending-signatures tests-pending labels Aug 30, 2021

jan-kaspar mentioned this pull request Sep 7, 2021

PPS: preparation for 2022 conditions cms-sw/cmssw#35177

Merged

cmsbuild added tests-started and removed tests-pending labels Sep 7, 2021

cmsbuild added tests-rejected and removed tests-started labels Sep 7, 2021

cmsbuild added tests-started and removed tests-rejected labels Sep 7, 2021

cmsbuild added tests-approved and removed tests-started labels Sep 7, 2021

cmsbuild added alca-approved and removed alca-pending labels Sep 7, 2021

cmsbuild added externals-approved fully-signed and removed pending-signatures externals-pending labels Sep 8, 2021

mrodozov merged commit 9ca02dc into cms-data:master Sep 8, 2021

cmsbuild mentioned this pull request Sep 8, 2021

Update tag for CalibPPS-ESProducers to V01-04-00 cms-sw/cmsdist#7282

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

optics for Run3 (prelim.) #5

optics for Run3 (prelim.) #5

michael-pitt commented Aug 30, 2021

cmsbuild commented Aug 30, 2021

jan-kaspar commented Sep 7, 2021

tvami commented Sep 7, 2021

cmsbuild commented Sep 7, 2021

smuzaffar commented Sep 7, 2021

cmsbuild commented Sep 7, 2021

tvami commented Sep 7, 2021

mrodozov commented Sep 8, 2021

cmsbuild commented Sep 8, 2021

optics for Run3 (prelim.) #5

optics for Run3 (prelim.) #5

Conversation

michael-pitt commented Aug 30, 2021

cmsbuild commented Aug 30, 2021

jan-kaspar commented Sep 7, 2021

tvami commented Sep 7, 2021

cmsbuild commented Sep 7, 2021

RelVals

AddOn Tests

smuzaffar commented Sep 7, 2021

cmsbuild commented Sep 7, 2021

Comparison Summary

tvami commented Sep 7, 2021

mrodozov commented Sep 8, 2021

cmsbuild commented Sep 8, 2021