Global Tag updates for 81x: introducing new L1 uGT stage-II menu and MC updates for Digi-Reco #13709

mmusich · 2016-03-14T13:01:00Z

Summary of changes in Global Tags

RunII simulation

RunII Ideal scenario : 80X_mcRun2_design_v9 as 80X_mcRun2_design_v6 with the following changes:
- updated ES ChannelStatus start 2016 : (2x32) sensors dead
- updated ES pedestal/noise 137216 channels with (2x32) sensors out : ADC mean = 1300, RMS = 3.
- updated Hcal channel quality for MC (copy from the last approved condition on Fev/2016)
- updated Hcal QIE data post LS1
- added first L1T stage-2 uGT menu
- updated SiPixel Dynamic inefficiency for 2016 (based on 2015 measurements)
RunII CRAFT scenario : 80X_mcRun2cosmics_startup_peak_v8 as 80X_mcRun2cosmics_startup_peak_v4 with the following changes:
- updated ES ChannelStatus start 2016 : (2x32) sensors dead
- updated ES pedestal/noise 137216 channels with (2x32) sensors out : ADC mean = 1300, RMS = 3.
- updated Hcal channel quality for MC (copy from the last approved condition on Fev/2016)
- updated Hcal QIE data post LS1
- added first L1T stage-2 uGT menu
- updated HLT JEC to payloads with L2/L3 residuals to allow integrtation of new paths in menu
- updated SiPixel Dynamic inefficiency for 2016 (based on 2015 measurements)
RunII Asymptotic scenario : 80X_mcRun2_asymptotic_v9 as 80X_mcRun2_asymptotic_v6 with the following changes:
- updated ES ChannelStatus start 2016 : (2x32) sensors dead
- updated ES pedestal/noise 137216 channels with (2x32) sensors out : ADC mean = 1300, RMS = 3.
- updated Hcal channel quality for MC (copy from the last approved condition on Fev/2016)
- updated Hcal QIE data post LS1
- added first L1T stage-2 uGT menu
- updated non-zero muon DT alignment uncertainties defined by the comparison of asymptotic and ideal MC geometries (quadratic sum of RMS and mean shifts on homogeneous sets of chambers).
- updated non-zero muon CSC alignment uncertainties defined by the comparison of asymptotic and ideal MC geometries (quadratic sum of RMS and mean shifts on homogeneous sets of chambers).
- updated Ecal laser transparency: as start 2016 + 15/fb prediction
- updated Ecal noise: 2015 + 15/fb prediction
- updated Ecal tuning of the thresholds of the zero-suppression (ZS tag), to safely run with a PU up to ~ 40-50.
- updated Ecal tuning of the thresholds of the selective-readout (TPG tag), to safely run with a PU up to ~ 40-50.
- updated SiStrip bad channels payload for 2016 MC campaigns. Computed using Run 260627. This considers optimistic scenario where the active channels have been defined using Fed Cabling payload.
- updated SiPixel Dynamic inefficiency for 2016 (based on 2015 measurements)
RunII Startup scenario : 80X_mcRun2_startup_v9 as 80X_mcRun2_startup_v6 with the following changes:
- updated ES ChannelStatus start 2016 : (2x32) sensors dead
- updated ES pedestal/noise 137216 channels with (2x32) sensors out : ADC mean = 1300, RMS = 3.
- updated Hcal channel quality for MC (copy from the last approved condition on Fev/2016)
- updated Hcal QIE data post LS1
- added first L1T stage-2 uGT menu
- updated SiPixel Dynamic inefficiency for 2016 (based on 2015 measurements)
RunII Heavy Ions scenario : 80X_mcRun2_HeavyIon_v7 as 80X_mcRun2_HeavyIon_v5 with the following changes:
- updated Hcal QIEData mc tag to reflect situation in data (2016)
- updated ES ChannelStatus start 2016 : (2x32) sensors dead
- updated ES pedestal/noise 137216 channels with (2x32) sensors out : ADC mean = 1300, RMS = 3.
- updated Hcal channel quality for MC (copy from the last approved condition on Fev/2016)
- updated Hcal QIE data post LS1
- added first Heavy Ions L1T stage-2 uGT menu

RunII data

RunII Offline processing : 80X_dataRun2_v9 as 80X_dataRun2_v8 with the following changes:
- updated AlCaReco trigger bit to allow new SiStripAfterAbortGap AlcaRecos in the matrix
- updared CSC Xtalk payload to fix the incorrect values for ME-2/1/03.
- introducing "all-uTCA" HBHE Electronics Map
- adding Stage2 uGT L1T menu
RunII HLTHI processing : 80X_dataRun2_HLTHI_frozen_v7 as 80X_dataRun2_HLTHI_frozen_v6 with the following changes:
- introducing HI Stage-II L1T menu for Release validation
RunII HLT relval processing : 80X_dataRun2_HLT_relval_v4 as 80X_dataRun2_HLT_relval_v3 with the following changes:
- introducing Stage-II L1T menu for Release validation
RunII HLT processing : 80X_dataRun2_HLT_frozen_v8 as 80X_dataRun2_HLT_frozen_v6 with the following changes:
- better name for O2O tag for Stage 2 L1T menu.
RunII Offline relval processing : 80X_dataRun2_relval_v4 as 80X_dataRun2_relval_v3 with the following changes:
- updated AlCaReco trigger bit to allow new SiStripAfterAbortGap AlcaRecos in the matrix
- updared CSC Xtalk payload to fix the incorrect values for ME-2/1/03.
- introducing "all-uTCA" HBHE Electronics Map
- adding Stage2 uGT L1T menu

Upgrade

PhaseI design scenario : 80X_upgrade2017_design_v6 as 80X_upgrade2017_design_v4 with the following changes:
- updated Hcal QIE data post LS1
- added Pixel Dynamic inefficiency for phase-I

…d upgrade 2017

cmsbuild · 2016-03-14T13:01:24Z

A new Pull Request was created by @mmusich (Marco Musich) for CMSSW_8_1_X.

It involves the following packages:

Configuration/AlCa
Configuration/PyReleaseValidation

@diguida, @boudoul, @franzoni, @cerminar, @fabozzi, @cmsbuild, @srimanob, @mmusich, @hengne, @davidlange6 can you please review it and eventually sign? Thanks.
@ghellwig, @Martin-Grunewald, @tocheng this is something you requested to watch as well.
@slava77, @Degano, @smuzaffar you are the release manager for this.

cms-bot commands are list here #13028

mmusich · 2016-03-14T13:22:05Z

hold
mc workflows are expected to fail with:

----- Begin Fatal Exception 14-Mar-2016 13:06:30 CET-----------------------
An exception of category 'Conditions not found' occurred while
   [0] Processing run: 1 lumi: 1 event: 1
   [1] Running path 'digitisation_step'
   [2] Calling event method for module MixingModule/'mix'
Exception Message:
Unavailable Conditions of type HcalQIEData for cell (0x54000051) (ZDC+ EM 1,1)
----- End Fatal Exception -------------------------------------------------

will fix as soon as new tag is made available

cmsbuild · 2016-03-14T13:22:26Z

Pull request has been put on hold by @mmusich
They need to issue an unhold command to remove the hold state or L1 can unhold it for all

davidlange6 · 2016-03-15T08:39:17Z

cmsbuild, please test

cmsbuild · 2016-03-15T08:42:27Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/11890/console

mmusich · 2016-03-15T08:48:30Z

Hi @davidlange6, the GTs as they are will fail for two different reasons:

as pointed out in Global Tag updates for 81x: introducing new L1 uGT stage-II menu and MC updates for Digi-Reco #13709 (comment) there is an issue with the new Hcal QIEData, we have the tag correcting for that: message in AlCa HN
we still miss a fix for the CSC tags update that causes the issue reported in RelVal HN affecting the GT for MC Digi-Reco as well.

cmsbuild · 2016-03-15T10:16:00Z

-1
Tested at: 56cba61
When I ran the RelVals I found an error in the following worklfows:
135.4 step1

runTheMatrix-results/135.4_ZEE_13+ZEEFS_13+HARVESTUP15FS+MINIAODMCUP15FS/step1_ZEE_13+ZEEFS_13+HARVESTUP15FS+MINIAODMCUP15FS.log
----- Begin Fatal Exception 15-Mar-2016 10:29:31 CET-----------------------
An exception of category 'Conditions not found' occurred while
   [0] Processing run: 1 lumi: 1 event: 1
   [1] Running path 'digitisation_step'
   [2] Calling event method for module MixingModule/'mix'
Exception Message:
Unavailable Conditions of type HcalQIEData for cell (0x54000051) (ZDC+ EM 1,1)
----- End Fatal Exception -------------------------------------------------

1306.0 step2

runTheMatrix-results/1306.0_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15/step2_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15.log
----- Begin Fatal Exception 15-Mar-2016 10:29:56 CET-----------------------
An exception of category 'Conditions not found' occurred while
   [0] Processing run: 1 lumi: 1 event: 1
   [1] Running path 'digitisation_step'
   [2] Calling event method for module MixingModule/'mix'
Exception Message:
Unavailable Conditions of type HcalQIEData for cell (0x54000051) (ZDC+ EM 1,1)
----- End Fatal Exception -------------------------------------------------

1330.0 step2

runTheMatrix-results/1330.0_ZMM_13+ZMM_13+DIGIUP15+RECOUP15+HARVESTUP15/step2_ZMM_13+ZMM_13+DIGIUP15+RECOUP15+HARVESTUP15.log
----- Begin Fatal Exception 15-Mar-2016 10:35:36 CET-----------------------
An exception of category 'Conditions not found' occurred while
   [0] Processing run: 1 lumi: 1 event: 1
   [1] Running path 'digitisation_step'
   [2] Calling event method for module MixingModule/'mix'
Exception Message:
Unavailable Conditions of type HcalQIEData for cell (0x54000051) (ZDC+ EM 1,1)
----- End Fatal Exception -------------------------------------------------

50202.0 step2

runTheMatrix-results/50202.0_TTbar_13+TTbar_13+DIGIUP15_PU50+RECOUP15_PU50+HARVESTUP15_PU50/step2_TTbar_13+TTbar_13+DIGIUP15_PU50+RECOUP15_PU50+HARVESTUP15_PU50.log
----- Begin Fatal Exception 15-Mar-2016 10:44:10 CET-----------------------
An exception of category 'Conditions not found' occurred while
   [0] Processing run: 1 lumi: 1 event: 1
   [1] Running path 'digitisation_step'
   [2] Calling event method for module MixingModule/'mix'
Exception Message:
Unavailable Conditions of type HcalQIEData for cell (0x54000051) (ZDC+ EM 1,1)
----- End Fatal Exception -------------------------------------------------

25202.0 step2

runTheMatrix-results/25202.0_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25/step2_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25.log

you can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-13709/11890/summary.html

cmsbuild · 2016-03-15T15:07:17Z

Pull request #13709 was updated. @diguida, @boudoul, @franzoni, @cerminar, @fabozzi, @cmsbuild, @srimanob, @mmusich, @hengne, @davidlange6 can you please check and sign again.

cmsbuild · 2016-03-15T15:10:05Z

Pull request #13709 was updated. @diguida, @boudoul, @franzoni, @cerminar, @fabozzi, @cmsbuild, @srimanob, @mmusich, @hengne, @davidlange6 can you please check and sign again.

mmusich · 2016-03-15T15:18:38Z

unhold

cmsbuild · 2016-03-17T20:06:59Z

Pull request #13709 was updated. @diguida, @boudoul, @franzoni, @cerminar, @fabozzi, @cmsbuild, @srimanob, @mmusich, @hengne, @davidlange6 can you please check and sign again.

mmusich · 2016-03-17T20:07:40Z

@cmkuo thanks for the fix.
The new ES pedestals tag locally runs fine. Let's give a further try.

mmusich · 2016-03-17T20:07:47Z

please test

cmsbuild · 2016-03-17T20:08:04Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/11952/console

cmsbuild · 2016-03-17T22:42:43Z

+1
Tested at: 19d11d8
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-13709/11952/summary.html

cmsbuild · 2016-03-18T00:19:51Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-13709/11952/summary.html

mmusich · 2016-03-18T07:56:45Z

+1

mmusich · 2016-03-18T07:58:38Z

@hengne @fabozzi I removed some relic dependency in relval_steps.py of the run2_data key which has the O2O tag for the L1 menu (hence not good for the HLT step in relvals).
Can you please review and sign?

hengne · 2016-03-18T09:29:40Z

+1

cmsbuild · 2016-03-18T09:30:00Z

This pull request is fully signed and it will be integrated in one of the next CMSSW_8_1_X IBs (tests are also fine). This pull request requires discussion in the ORP meeting before it's merged. @slava77, @davidlange6, @Degano, @smuzaffar

davidlange6 · 2016-03-18T12:13:09Z

+1

Global Tag updates for 81x: introducing new L1 uGT stage-II menu and MC updates for Digi-Reco

Martin-Grunewald · 2016-03-19T21:11:55Z

Hi @mmusich

The GT for 2017 also needs the new L1 menu (there are workflows with L1T):
https://cmssdt.cern.ch/lxr/source/Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py?v=CMSSW_8_1_X_2016-03-18-2300#0023

so one needs:

autoCond['phase1_2017_design'] = ( autoCond['phase1_2017_design'],) + l1Menus['GRun']

Can you add this for 81X and also to the 80X PR?

mmusich · 2016-03-21T08:19:41Z

Hi @Martin-Grunewald. Will do.
M.

mmusich added 3 commits March 14, 2016 13:51

Adding AlCaRecoTriggerBit for SiStripAfterAbortGap

658579d

Updated Global Tag for all workflows: Run2 Data, Run2 HLT, Run2 MC an…

6115f4a

…d upgrade 2017

removing dependencies on run2_data key in RelVal steps

0ef5db7

cmsbuild added this to the Next CMSSW_8_1_X milestone Mar 14, 2016

cmsbuild added alca-pending pending-signatures tests-pending orp-pending comparison-pending pdmv-pending labels Mar 14, 2016

Updating also Run2 HLT relval GT

56cba61

cmsbuild added the hold label Mar 14, 2016

cmsbuild added tests-started and removed tests-pending labels Mar 15, 2016

cmsbuild added tests-rejected tests-pending and removed tests-started tests-rejected labels Mar 15, 2016

Reverting CSC updates in MC queues

4845f8f

mmusich force-pushed the GTs_updates_81X branch from 0f6ea92 to 4845f8f Compare March 15, 2016 15:09

cmsbuild added the tests-pending label Mar 17, 2016

cmsbuild added tests-started and removed tests-pending labels Mar 17, 2016

cmsbuild added tests-approved and removed tests-started labels Mar 17, 2016

cmsbuild added comparison-available and removed comparison-pending labels Mar 18, 2016

cmsbuild added alca-approved and removed alca-pending labels Mar 18, 2016

cmsbuild added fully-signed pdmv-approved and removed pdmv-pending pending-signatures labels Mar 18, 2016

cmsbuild added orp-approved and removed orp-pending labels Mar 18, 2016

cmsbuild added a commit that referenced this pull request Mar 18, 2016

Merge pull request #13709 from mmusich/GTs_updates_81X

32a72ed

Global Tag updates for 81x: introducing new L1 uGT stage-II menu and MC updates for Digi-Reco

cmsbuild merged commit 32a72ed into cms-sw:CMSSW_8_1_X Mar 18, 2016

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Global Tag updates for 81x: introducing new L1 uGT stage-II menu and MC updates for Digi-Reco #13709

Global Tag updates for 81x: introducing new L1 uGT stage-II menu and MC updates for Digi-Reco #13709

mmusich commented Mar 14, 2016

cmsbuild commented Mar 14, 2016

mmusich commented Mar 14, 2016

cmsbuild commented Mar 14, 2016

davidlange6 commented Mar 15, 2016

cmsbuild commented Mar 15, 2016

mmusich commented Mar 15, 2016

cmsbuild commented Mar 15, 2016

cmsbuild commented Mar 15, 2016

cmsbuild commented Mar 15, 2016

mmusich commented Mar 15, 2016

cmsbuild commented Mar 17, 2016

mmusich commented Mar 17, 2016

mmusich commented Mar 17, 2016

cmsbuild commented Mar 17, 2016

cmsbuild commented Mar 17, 2016

cmsbuild commented Mar 18, 2016

mmusich commented Mar 18, 2016

mmusich commented Mar 18, 2016

hengne commented Mar 18, 2016

cmsbuild commented Mar 18, 2016

davidlange6 commented Mar 18, 2016

Martin-Grunewald commented Mar 19, 2016

mmusich commented Mar 21, 2016

Global Tag updates for 81x: introducing new L1 uGT stage-II menu and MC updates for Digi-Reco #13709

Global Tag updates for 81x: introducing new L1 uGT stage-II menu and MC updates for Digi-Reco #13709

Conversation

mmusich commented Mar 14, 2016

Summary of changes in Global Tags

RunII simulation

RunII data

Upgrade

cmsbuild commented Mar 14, 2016

mmusich commented Mar 14, 2016

cmsbuild commented Mar 14, 2016

davidlange6 commented Mar 15, 2016

cmsbuild commented Mar 15, 2016

mmusich commented Mar 15, 2016

cmsbuild commented Mar 15, 2016

cmsbuild commented Mar 15, 2016

cmsbuild commented Mar 15, 2016

mmusich commented Mar 15, 2016

cmsbuild commented Mar 17, 2016

mmusich commented Mar 17, 2016

mmusich commented Mar 17, 2016

cmsbuild commented Mar 17, 2016

cmsbuild commented Mar 17, 2016

cmsbuild commented Mar 18, 2016

mmusich commented Mar 18, 2016

mmusich commented Mar 18, 2016

hengne commented Mar 18, 2016

cmsbuild commented Mar 18, 2016

davidlange6 commented Mar 18, 2016

Martin-Grunewald commented Mar 19, 2016

mmusich commented Mar 21, 2016