Update BeamSpotOnline tags for CRUZET [11_3_X] #34333

francescobrivio · 2021-07-05T14:17:37Z

PR description:

This PR updates the BeamSpotOnline tags to the "production" version (i.e. removed the word Test from the tag name)
to be used at HLT and in Express for CRUZET onwards:

udpated names of the tags in the DQM online clients that write the payloads
removed the ESSource in the onlinebeammonitor DQM client (avaid crash from multiple sources)
add to autoCond.py HLT and Express candidate GTs which contain the new tags:
- BeamSpotOnlineHLT
- BeamSpotOnlineLegacy

As agreed with TRK DPG and POG (FYI @mtosi @mmusich) for now the tags only contain one payload with since = 1 and with a "fakeBS":

 Beam type    = -1
       X0     = 0.0001 +/- 0 [cm]
       Y0     = 0.0001 +/- 0 [cm]
       Z0     = 0.0001 +/- 0 [cm]
 Sigma Z0     = 15 +/- 0 [cm]
 dxdz         = 0 +/- 0 [radians]
 dydz         = 0 +/- 0 [radians]
 Beam Width X = 0.1 +/- 0 [cm]
 Beam Width Y = 0.1 +/- 0 [cm]
 Emittance X  = 0 [cm]
 Emittance Y  = 0 [cm]
 Beta star    = 0 [cm]
 Last Lumi    = 1
 Last Run     = 1
 Last Fill    = 0

The GT diffs are as follow:
HLT: https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/113X_dataRun3_HLT_Candidate_2021_07_02_14_05_25/113X_dataRun3_HLT_v2
Express: https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/113X_dataRun3_Express_Candidate_2021_07_02_14_38_40/113X_dataRun3_Express_v3

IMPORTANT NOTE
This PR is needed to DQM in order to test the candidates, once both DQM and HLT confirm the candidates are fine they will be turned into versioned GTs and I will update this PR. This is needed for CRUZET.
FYI @qliphy @silviodonato @amassiro @boudoul

-EDIT-
DQM and HLT validated the candidates (HN message), so I made the versioned GTs for CRUZET by copying the candidates:
HLT: 113X_dataRun3_HLT_v3
Express: 113X_dataRun3_Express_v4
The new diffs are:
Run 3 data HLT
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/113X_dataRun3_HLT_v2/113X_dataRun3_HLT_v3

Run 3 data (express)
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/113X_dataRun3_Express_v3/113X_dataRun3_Express_v4

PR validation:

Tested with:

runTheMatrix.py -l 138.2 --ibeos -j 8
addOnTests.py -j 8

Back/Forward-port:

This will be forward-ported to master.

cmsbuild · 2021-07-05T14:18:03Z

A new Pull Request was created by @francescobrivio for CMSSW_11_3_X.

It involves the following packages:

Configuration/AlCa
DQM/Integration

@malbouis, @andrius-k, @yuanchao, @kmaeshima, @ErnestaP, @ahmad3213, @rvenditti, @cmsbuild, @jfernan2, @tlampen, @pohsun, @francescobrivio, @tvami can you please review it and eventually sign? Thanks.
@batinkov, @battibass, @makortel, @tocheng, @Martin-Grunewald, @mmusich, @threus, @fabiocos this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

francescobrivio · 2021-07-05T14:27:41Z

test parameters:

workflow = 138.2

francescobrivio · 2021-07-05T14:28:55Z

@cmsbuild please test

cmsbuild · 2021-07-05T17:15:40Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e8cfd6/16470/summary.html
COMMIT: cfad201
CMSSW: CMSSW_11_3_X_2021-07-05-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34333/16470/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-e8cfd6/138.2_RunCosmics2020+RunCosmics2020+RECOCOSDEXPRUN3+ALCACOSDEXPRUN3+HARVESTDCEXPRUN3

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 38
DQMHistoTests: Total histograms compared: 2877978
DQMHistoTests: Total failures: 1
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2877955
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 37 files compared)
Checked 160 log files, 37 edm output root files, 38 DQM output files
TriggerResults: no differences found

jfernan2 · 2021-07-05T17:41:02Z

+1
Tested sucessfully at Online DQM in P5.
@francescobrivio @gennai Perhaps we need a forward port of at least the changes in the OnlineBeamSpot Monitor to not lose this fix for the master version.
Thank you!

francescobrivio · 2021-07-05T21:25:45Z

+1
Tested sucessfully at Online DQM in P5.
@francescobrivio @gennai Perhaps we need a forward port of at least the changes in the OnlineBeamSpot Monitor to not lose this fix for the master version.
Thank you!

thanks @jfernan2! A forward port is planned as soon as we also get confirmation of the candidates from HLT (hopefully tomorrow morning) and we can create versioned GTs to be put in autoCond.

gennai · 2021-07-06T06:44:19Z

I am on it now.

cmsbuild · 2021-07-06T07:46:03Z

Pull request #34333 was updated. @malbouis, @andrius-k, @yuanchao, @kmaeshima, @ErnestaP, @ahmad3213, @rvenditti, @cmsbuild, @jfernan2, @tlampen, @pohsun, @francescobrivio, @tvami can you please check and sign again.

francescobrivio · 2021-07-06T07:47:16Z

test parameters:

workflow = 138.2

francescobrivio · 2021-07-06T07:47:29Z

@cmsbuild please test

francescobrivio · 2021-07-06T07:47:41Z

urgent

jfernan2 · 2021-07-06T07:48:31Z

@francescobrivio should we test again at P5 the new GTs 113X_dataRun3_HLT_v3/4 or are they copies of the candidates 113X_dataRun3_Express_Candidate_2021_07_02_* ?
Thanks

francescobrivio · 2021-07-06T07:52:31Z

@francescobrivio should we test again at P5 the new GTs 113X_dataRun3_HLT_v3/4 or are they copies of the candidates 113X_dataRun3_Express_Candidate_2021_07_02_* ?
Thanks

@jfernan2 They are exact copies of the candidates you already tested, see:
HLT: https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/113X_dataRun3_HLT_Candidate_2021_07_02_14_05_25/113X_dataRun3_HLT_v3
Express: https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/113X_dataRun3_Express_Candidate_2021_07_02_14_38_40/113X_dataRun3_Express_v4
I updated the PR description to make it clear!

jfernan2 · 2021-07-06T07:56:16Z

OK, thanks for the confirmation!!

qliphy · 2021-07-06T09:29:49Z

forward port to #34348

cmsbuild · 2021-07-06T15:02:10Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e8cfd6/16486/summary.html
COMMIT: 018b6f4
CMSSW: CMSSW_11_3_X_2021-07-05-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34333/16486/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-e8cfd6/138.2_RunCosmics2020+RunCosmics2020+RECOCOSDEXPRUN3+ALCACOSDEXPRUN3+HARVESTDCEXPRUN3

Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 38
DQMHistoTests: Total histograms compared: 2877978
DQMHistoTests: Total failures: 6
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 2877949
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -0.004 KiB( 37 files compared)
DQMHistoSizes: changed ( 312.0 ): -0.004 KiB MessageLogger/Warnings
Checked 160 log files, 37 edm output root files, 38 DQM output files
TriggerResults: no differences found

francescobrivio · 2021-07-06T15:03:13Z

+alca

jfernan2 · 2021-07-06T15:03:16Z

+1

cmsbuild · 2021-07-06T15:03:30Z

This pull request is fully signed and it will be integrated in one of the next CMSSW_11_3_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_12_0_X is complete. This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

qliphy · 2021-07-07T13:09:10Z

+1

francescobrivio added 3 commits July 5, 2021 15:49

updated BeamSpotOnline tags names in DQM clients

da609b8

temporarily use GT candidates in HLT and Express GTs

0ab5df4

remove PoolDBESSource from onlinebeammonitor DQM client

cfad201

cmsbuild added this to the CMSSW_11_3_X milestone Jul 5, 2021

cmsbuild added alca-pending dqm-pending orp-pending pending-signatures tests-pending labels Jul 5, 2021

cmsbuild added tests-started and removed tests-pending labels Jul 5, 2021

cmsbuild added tests-approved and removed tests-started labels Jul 5, 2021

cmsbuild added dqm-approved and removed dqm-pending labels Jul 5, 2021

update GTs for CRUZET 2021

018b6f4

cmsbuild added dqm-pending tests-pending and removed dqm-approved tests-approved labels Jul 6, 2021

cmsbuild added tests-started urgent and removed tests-pending labels Jul 6, 2021

francescobrivio mentioned this pull request Jul 6, 2021

Update BeamSpotOnline tags for CRUZET #34348

Merged

cmsbuild added tests-approved and removed tests-started labels Jul 6, 2021

cmsbuild added alca-approved dqm-approved fully-signed and removed alca-pending dqm-pending pending-signatures labels Jul 6, 2021

cmsbuild added orp-approved and removed orp-pending labels Jul 7, 2021

cmsbuild merged commit 7f3a22a into cms-sw:CMSSW_11_3_X Jul 7, 2021

francescobrivio deleted the alca-CRUZET_GTs_11_3_X branch August 9, 2021 09:13

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update BeamSpotOnline tags for CRUZET [11_3_X] #34333

Update BeamSpotOnline tags for CRUZET [11_3_X] #34333

francescobrivio commented Jul 5, 2021 •

edited

cmsbuild commented Jul 5, 2021

francescobrivio commented Jul 5, 2021

francescobrivio commented Jul 5, 2021

cmsbuild commented Jul 5, 2021

jfernan2 commented Jul 5, 2021

francescobrivio commented Jul 5, 2021

gennai commented Jul 6, 2021

cmsbuild commented Jul 6, 2021

francescobrivio commented Jul 6, 2021

francescobrivio commented Jul 6, 2021

francescobrivio commented Jul 6, 2021

jfernan2 commented Jul 6, 2021

francescobrivio commented Jul 6, 2021 •

edited

jfernan2 commented Jul 6, 2021

qliphy commented Jul 6, 2021

cmsbuild commented Jul 6, 2021

francescobrivio commented Jul 6, 2021

jfernan2 commented Jul 6, 2021

cmsbuild commented Jul 6, 2021

qliphy commented Jul 7, 2021

Update BeamSpotOnline tags for CRUZET [11_3_X] #34333

Update BeamSpotOnline tags for CRUZET [11_3_X] #34333

Conversation

francescobrivio commented Jul 5, 2021 • edited

PR description:

PR validation:

Back/Forward-port:

cmsbuild commented Jul 5, 2021

francescobrivio commented Jul 5, 2021

francescobrivio commented Jul 5, 2021

cmsbuild commented Jul 5, 2021

Comparison Summary

jfernan2 commented Jul 5, 2021

francescobrivio commented Jul 5, 2021

gennai commented Jul 6, 2021

cmsbuild commented Jul 6, 2021

francescobrivio commented Jul 6, 2021

francescobrivio commented Jul 6, 2021

francescobrivio commented Jul 6, 2021

jfernan2 commented Jul 6, 2021

francescobrivio commented Jul 6, 2021 • edited

jfernan2 commented Jul 6, 2021

qliphy commented Jul 6, 2021

cmsbuild commented Jul 6, 2021

Comparison Summary

francescobrivio commented Jul 6, 2021

jfernan2 commented Jul 6, 2021

cmsbuild commented Jul 6, 2021

qliphy commented Jul 7, 2021

francescobrivio commented Jul 5, 2021 •

edited

francescobrivio commented Jul 6, 2021 •

edited