Update GENSIM string for 11_3_X IB test #33090

chayanit · 2021-03-07T06:12:11Z

Update GENSIM string in 11_3_X according to #33010 for PPS workflows, and add back PPS workflows to IB test (removed in #33020).

In addition, I think we should also update all Run3 workflows to 14TeV instead of 13TeV. This is for TTbar design Run3 2021 (12024 to 12034)

All GENSIM have been produced in 11_3_0_pre4
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?campaign=CMSSW_11_3_0_pre4__FullSim_2017GSonly_forIBTest-1615036406
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?campaign=CMSSW_11_3_0_pre4__FullSim_2018GSonly_forIBTest-1615036939
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?campaign=CMSSW_11_3_0_pre4__FullSim_Run3GSonly_forIBTest-1615037975
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?campaign=CMSSW_11_3_0_pre4__FullSim_2026GSonly_forIBTest-1615039204

chayanit · 2021-03-07T06:14:18Z

2026 GENSIM is still running so I will trigger the test when they finish (tomorrow)

cmsbuild · 2021-03-07T06:19:15Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-33090/21414

This PR adds an extra 48KB to repository
There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/PyReleaseValidation/python/relval_2017.py modified in PR(s): Squash all Patatrack developments on top of CMSSW_11_3_0_pre5 #27983, Patatrack integration - Pixel workflows (12/N) #31854
- File Configuration/PyReleaseValidation/python/relval_steps.py modified in PR(s): Add customisation to make sure that upgrade WFs will cross LS in the short matrix #32957, Squash all Patatrack developments on top of CMSSW_11_3_0_pre5 #27983, Patatrack integration - Pixel workflows (12/N) #31854

cmsbuild · 2021-03-07T06:19:36Z

A new Pull Request was created by @chayanit (Chayanit Asawatangtrakuldee) for master.

It involves the following packages:

Configuration/PyReleaseValidation

@jordan-martins, @chayanit, @wajidalikhan, @kpedro88, @cmsbuild, @srimanob can you please review it and eventually sign? Thanks.
@makortel, @Martin-Grunewald, @fabiocos, @slomeo this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

chayanit · 2021-03-08T07:18:23Z

please test

cmsbuild · 2021-03-08T10:00:52Z

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-933fe4/13327/summary.html
COMMIT: d74d192
CMSSW: CMSSW_11_3_X_2021-03-07-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/33090/13327/install.sh to create a dev area with all the needed externals and cmssw changes.

DAS Queries: The DAS query tests failed, see the summary page for details.

RelVals-INPUT

10001.0DAS Error
10002.0DAS Error
10003.0DAS Error

Expand to see more relval errors ...

10004.0
10005.0
10006.0
10007.0
10008.0
10009.0
10023.0
10024.0
10024.1
10024.2
10024.3
10024.4
10024.5
10025.0
10026.0
10042.0
10059.0
10071.0
10224.0
10224.15
10225.0
10424.0
10801.0
10802.0
10803.0
10804.0
10805.0
10806.0
10807.0
10808.0
10809.0
10823.0
10824.0
10824.1
10824.5
10824.501
10824.511
10824.521
10824.6
10824.8
10825.0
10826.0
10842.0
10842.501
10859.0
10871.0
11024.0
11024.15
11024.6
11025.0
11224.0
11224.6
11601.0
11602.0
11603.0
11604.0
11605.0
11606.0
11607.0
11608.0
11609.0
11630.0
11634.0
11634.1
11634.24
11634.5
11634.501
11634.511
11634.521
11634.7
11634.91
11640.0
11643.0
11646.0
11650.0
11650.501
11723.17
11725.0
11834.0
11834.13
11834.24
11834.99
11846.0
11925.0
12034.0
12434.0
12634.0
12634.99
12834.0
13034.0
13034.99
23234.0
23234.103
23234.21
23234.9
23434.21
23434.99
23434.999

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-933fe4/34634.0_TTbar_14TeV+2026D76+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-933fe4/34834.999_TTbar_14TeV+2026D76PU_PMXS1S2PR+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+PREMIX_PremixHLBeamSpot14PU+DigiTriggerPU+RecoGlobalPU+HARVESTGlobalPU

Summary:

No significant changes to the logs found
Reco comparison results: 3048 differences found in the comparisons
DQMHistoTests: Total files compared: 38
DQMHistoTests: Total histograms compared: 2849195
DQMHistoTests: Total failures: 6631
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2842542
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -0.117 KiB( 37 files compared)
DQMHistoSizes: changed ( 10224.0 ): -0.117 KiB SiStrip/MechanicalView
Checked 160 log files, 37 edm output root files, 38 DQM output files

silviodonato · 2021-03-08T14:10:43Z

As an example, looking at 10001.0 https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-933fe4/13327/runTheMatrixINPUT-results/10001.0_SingleElectronPt10+2017+SingleElectronPt10_pythia8_GenSimINPUT+Digi+RecoFakeHLT+HARVESTFakeHLT+ALCA+Nano/

I see that the DAS query is empty because /RelValTTbar_14TeV/CMSSW_11_3_0_pre4-113X_mcRun3_2021_design_v5-v1/GEN-SIM is not found at T2_CERN. However, I see that this dataset is available at T1_US_FNAL_Disk and T2_ES_CIEMAT. @smuzaffar @makortel do we need to copy the samples at CERN?

makortel · 2021-03-08T14:52:12Z

I see that the DAS query is empty because /RelValTTbar_14TeV/CMSSW_11_3_0_pre4-113X_mcRun3_2021_design_v5-v1/GEN-SIM is not found at T2_CERN. However, I see that this dataset is available at T1_US_FNAL_Disk and T2_ES_CIEMAT. @smuzaffar @makortel do we need to copy the samples at CERN?

I had the impression the IB system would automatically cache files that are generally available but not at CERN.

smuzaffar · 2021-03-08T14:53:54Z

please test
@silviodonato , no need to request the transfer to CERN. These are new queries which are not yet cached by bot. In an hour or so bot will read these queries run by this PR tests and will cache the results. I have restarted the tests as by now the das queries should already be cached.

cmsbuild · 2021-03-08T17:29:03Z

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-933fe4/13337/summary.html
COMMIT: d74d192
CMSSW: CMSSW_11_3_X_2021-03-07-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/33090/13337/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

12634.9912634.99_TTbar_14TeV+2023PU_PMXS1S2+TTbar_14TeV_TuneCP5_GenSimINPUT+PREMIX_PremixPU+DigiPU+RecoPU+HARVESTPU+Nano/step2_TTbar_14TeV+2023PU_PMXS1S2+TTbar_14TeV_TuneCP5_GenSimINPUT+PREMIX_PremixPU+DigiPU+RecoPU+HARVESTPU+Nano.log
13034.9913034.99_TTbar_14TeV+2024PU_PMXS1S2+TTbar_14TeV_TuneCP5_GenSimINPUT+PREMIX_PremixPU+DigiPU+RecoPU+HARVESTPU+Nano/step2_TTbar_14TeV+2024PU_PMXS1S2+TTbar_14TeV_TuneCP5_GenSimINPUT+PREMIX_PremixPU+DigiPU+RecoPU+HARVESTPU+Nano.log
12634.012634.0_TTbar_14TeV+2023PU+TTbar_14TeV_TuneCP5_GenSimINPUT+DigiPU+RecoPU+HARVESTPU+Nano/step2_TTbar_14TeV+2023PU+TTbar_14TeV_TuneCP5_GenSimINPUT+DigiPU+RecoPU+HARVESTPU+Nano.log

Expand to see more relval errors ...

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-933fe4/34634.0_TTbar_14TeV+2026D76+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-933fe4/34834.999_TTbar_14TeV+2026D76PU_PMXS1S2PR+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+PREMIX_PremixHLBeamSpot14PU+DigiTriggerPU+RecoGlobalPU+HARVESTGlobalPU

Summary:

No significant changes to the logs found
Reco comparison results: 3049 differences found in the comparisons
DQMHistoTests: Total files compared: 38
DQMHistoTests: Total histograms compared: 2849195
DQMHistoTests: Total failures: 6637
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2842536
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -0.117 KiB( 37 files compared)
DQMHistoSizes: changed ( 10224.0 ): -0.117 KiB SiStrip/MechanicalView
Checked 160 log files, 37 edm output root files, 38 DQM output files

cmsbuild · 2021-03-08T17:29:04Z

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-933fe4/13337/summary.html
COMMIT: d74d192
CMSSW: CMSSW_11_3_X_2021-03-07-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/33090/13337/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

12634.9912634.99_TTbar_14TeV+2023PU_PMXS1S2+TTbar_14TeV_TuneCP5_GenSimINPUT+PREMIX_PremixPU+DigiPU+RecoPU+HARVESTPU+Nano/step2_TTbar_14TeV+2023PU_PMXS1S2+TTbar_14TeV_TuneCP5_GenSimINPUT+PREMIX_PremixPU+DigiPU+RecoPU+HARVESTPU+Nano.log
13034.9913034.99_TTbar_14TeV+2024PU_PMXS1S2+TTbar_14TeV_TuneCP5_GenSimINPUT+PREMIX_PremixPU+DigiPU+RecoPU+HARVESTPU+Nano/step2_TTbar_14TeV+2024PU_PMXS1S2+TTbar_14TeV_TuneCP5_GenSimINPUT+PREMIX_PremixPU+DigiPU+RecoPU+HARVESTPU+Nano.log
12634.012634.0_TTbar_14TeV+2023PU+TTbar_14TeV_TuneCP5_GenSimINPUT+DigiPU+RecoPU+HARVESTPU+Nano/step2_TTbar_14TeV+2023PU+TTbar_14TeV_TuneCP5_GenSimINPUT+DigiPU+RecoPU+HARVESTPU+Nano.log

Expand to see more relval errors ...

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-933fe4/34634.0_TTbar_14TeV+2026D76+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-933fe4/34834.999_TTbar_14TeV+2026D76PU_PMXS1S2PR+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+PREMIX_PremixHLBeamSpot14PU+DigiTriggerPU+RecoGlobalPU+HARVESTGlobalPU

Summary:

No significant changes to the logs found
Reco comparison results: 3049 differences found in the comparisons
DQMHistoTests: Total files compared: 38
DQMHistoTests: Total histograms compared: 2849195
DQMHistoTests: Total failures: 6637
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2842536
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -0.117 KiB( 37 files compared)
DQMHistoSizes: changed ( 10224.0 ): -0.117 KiB SiStrip/MechanicalView
Checked 160 log files, 37 edm output root files, 38 DQM output files

cmsbuild · 2021-03-18T19:25:05Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-933fe4/13599/summary.html
COMMIT: d74d192
CMSSW: CMSSW_11_3_X_2021-03-18-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/33090/13599/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 3106 differences found in the comparisons
DQMHistoTests: Total files compared: 37
DQMHistoTests: Total histograms compared: 2639935
DQMHistoTests: Total failures: 6734
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2633179
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -0.117 KiB( 36 files compared)
DQMHistoSizes: changed ( 10224.0 ): -0.117 KiB SiStrip/MechanicalView
Checked 155 log files, 37 edm output root files, 37 DQM output files
TriggerResults: found differences in 1 / 36 workflows

chayanit · 2021-03-19T02:34:21Z

I also have no clue @qliphy

qliphy · 2021-03-23T00:38:00Z

please test

cmsbuild · 2021-03-23T03:14:13Z

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-933fe4/13683/summary.html
COMMIT: d74d192
CMSSW: CMSSW_11_3_X_2021-03-22-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/33090/13683/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

11925.011925.0_GluGluTo2Jets_14TeV+2021PU+GluGluTo2Jets_M_300_2000_14TeV_Exhume_GenSimINPUT+DigiPU+RecoPU+HARVESTPU+Nano/step2_GluGluTo2Jets_14TeV+2021PU+GluGluTo2Jets_M_300_2000_14TeV_Exhume_GenSimINPUT+DigiPU+RecoPU+HARVESTPU+Nano.log
12634.012634.0_TTbar_14TeV+2023PU+TTbar_14TeV_TuneCP5_GenSimINPUT+DigiPU+RecoPU+HARVESTPU+Nano/step2_TTbar_14TeV+2023PU+TTbar_14TeV_TuneCP5_GenSimINPUT+DigiPU+RecoPU+HARVESTPU+Nano.log
12834.012834.0_TTbar_14TeV+2024+TTbar_14TeV_TuneCP5_GenSimINPUT+Digi+Reco+HARVEST+ALCA/step2_TTbar_14TeV+2024+TTbar_14TeV_TuneCP5_GenSimINPUT+Digi+Reco+HARVEST+ALCA.log

Comparison Summary

Summary:

No significant changes to the logs found
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 3076 differences found in the comparisons
DQMHistoTests: Total files compared: 37
DQMHistoTests: Total histograms compared: 2639935
DQMHistoTests: Total failures: 7129
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2632784
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.181 KiB( 36 files compared)
DQMHistoSizes: changed ( 10224.0 ): 0.181 KiB SiStrip/MechanicalView
Checked 155 log files, 37 edm output root files, 37 DQM output files
TriggerResults: found differences in 1 / 36 workflows

silviodonato · 2021-03-23T07:57:50Z

@cms-sw/upgrade-l2 @cms-sw/pdmv-l2 we are changing the input GEN-SIM files, so the differences are expected. I think we can merge this PR as it is.
The " RelVals-INPUT" test was ok in the previous tests.

chayanit · 2021-03-23T08:35:34Z

+1

srimanob · 2021-03-23T09:04:49Z

+Upgrade

cmsbuild · 2021-03-23T09:05:11Z

This pull request is fully signed and it will be integrated in one of the next master IBs (but tests are reportedly failing). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

silviodonato · 2021-03-23T09:26:47Z

+1

silviodonato · 2021-03-23T09:58:41Z

merge

Update GENSIM string for 11_3_X IB test

d74d192

cmsbuild added this to the CMSSW_11_3_X milestone Mar 7, 2021

cmsbuild added code-checks-pending orp-pending pdmv-pending pending-signatures tests-pending upgrade-pending labels Mar 7, 2021

chayanit mentioned this pull request Mar 7, 2021

Missing GEN-SIM input file for 11725.0 and 11925.0 #33010

Closed

cmsbuild added code-checks-approved and removed code-checks-pending labels Mar 7, 2021

cmsbuild mentioned this pull request Mar 7, 2021

Squash all Patatrack developments on top of CMSSW_11_3_0_pre5 #27983

Closed

cmsbuild added tests-started and removed tests-pending labels Mar 8, 2021

cmsbuild added tests-rejected and removed tests-started labels Mar 8, 2021

cmsbuild added tests-started and removed tests-rejected labels Mar 8, 2021

cmsbuild added tests-rejected and removed tests-started labels Mar 8, 2021

cmsbuild added tests-approved and removed tests-started labels Mar 18, 2021

cmsbuild added tests-started and removed tests-approved labels Mar 23, 2021

cmsbuild added tests-rejected and removed tests-started labels Mar 23, 2021

cmsbuild added pdmv-approved and removed pdmv-pending labels Mar 23, 2021

cmsbuild added fully-signed upgrade-approved and removed pending-signatures upgrade-pending labels Mar 23, 2021

cmsbuild mentioned this pull request Mar 23, 2021

Patatrack integration - Pixel workflows (12/N) #31854

Merged

cmsbuild added orp-approved and removed orp-pending labels Mar 23, 2021

cmsbuild merged commit 0dc9613 into cms-sw:master Mar 23, 2021

This was referenced Mar 25, 2021

Re-enable ctppsProtons from recoCTPPSTask (Run-3 only) #33265

Closed

Re-enable ctppsProtons from recoCTPPSTask in Run-3 #33266

Merged

qliphy mentioned this pull request Jul 28, 2021

Update GT string for 12_0_X #34613

Merged

qliphy mentioned this pull request Sep 9, 2021

New Run3 offline GT #35202

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update GENSIM string for 11_3_X IB test #33090

Update GENSIM string for 11_3_X IB test #33090

chayanit commented Mar 7, 2021

chayanit commented Mar 7, 2021

cmsbuild commented Mar 7, 2021

cmsbuild commented Mar 7, 2021

chayanit commented Mar 8, 2021

cmsbuild commented Mar 8, 2021

silviodonato commented Mar 8, 2021

makortel commented Mar 8, 2021

smuzaffar commented Mar 8, 2021

cmsbuild commented Mar 8, 2021

cmsbuild commented Mar 8, 2021

cmsbuild commented Mar 18, 2021

chayanit commented Mar 19, 2021

qliphy commented Mar 23, 2021

cmsbuild commented Mar 23, 2021

silviodonato commented Mar 23, 2021

chayanit commented Mar 23, 2021

srimanob commented Mar 23, 2021

cmsbuild commented Mar 23, 2021

silviodonato commented Mar 23, 2021

silviodonato commented Mar 23, 2021

Update GENSIM string for 11_3_X IB test #33090

Update GENSIM string for 11_3_X IB test #33090

Conversation

chayanit commented Mar 7, 2021

chayanit commented Mar 7, 2021

cmsbuild commented Mar 7, 2021

cmsbuild commented Mar 7, 2021

chayanit commented Mar 8, 2021

cmsbuild commented Mar 8, 2021

RelVals-INPUT

Comparison Summary

silviodonato commented Mar 8, 2021

makortel commented Mar 8, 2021

smuzaffar commented Mar 8, 2021

cmsbuild commented Mar 8, 2021

RelVals-INPUT

Comparison Summary

cmsbuild commented Mar 8, 2021

RelVals-INPUT

Comparison Summary

cmsbuild commented Mar 18, 2021

Comparison Summary

chayanit commented Mar 19, 2021

qliphy commented Mar 23, 2021

cmsbuild commented Mar 23, 2021

RelVals-INPUT

Comparison Summary

silviodonato commented Mar 23, 2021

chayanit commented Mar 23, 2021

srimanob commented Mar 23, 2021

cmsbuild commented Mar 23, 2021

silviodonato commented Mar 23, 2021

silviodonato commented Mar 23, 2021