add 2 production-like workflows for HI 2018

[zhenhu]

To solve issue #24587 .

Added two realistic chains that combine all the ingredients:

• the remapper introduced in Raw data remapper #24819 on input data in HI-like format, as proposed in make a T0-like relval for 2018 HI #24619

• the Run2_2018_pp_on_AA era

• the realistic sequence suggested by Slava: RAW2DIGI,L1Reco,RECO,EI,DQM:@common+@standardDQM+@ExtraHLT. (EI and DQM bugs have been fixed by Bug fixes to Run2_2018_pp_on_AA in EI and DQM #24958)

• the 103X_dataRun2_Prompt_v2 GT, the HIMinimumBias0 and HIMinimumBiasReducedFormat0 datasets, and Run 325174 suggested by Ivan

Local test with steamer files runs successfully. But the RAW files for run 325174 are not available on DAS yet.

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-25005/6983

[cmsbuild]

A new Pull Request was created by @zhenhu (Zhen Hu) for master.

It involves the following packages:

Configuration/PyReleaseValidation

@pgunnell, @zhenhu, @prebello, @cmsbuild, @kpedro88 can you please review it and eventually sign? Thanks.
@makortel, @Martin-Grunewald this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

[zhenhu]

please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/31276/console Started: 2018/10/25 22:59

[cmsbuild]

+1
Tested at: 049ffd1
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25005/31276/summary.html

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25005/31276/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 32
• DQMHistoTests: Total histograms compared: 2994843
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2994645
• DQMHistoTests: Total skipped: 197
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
• Checked 134 log files, 14 edm output root files, 32 DQM output files

[zhenhu]

+1

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-25005/7004

[cmsbuild]

Pull request #25005 was updated. @pgunnell, @zhenhu, @prebello, @cmsbuild, @kpedro88 can you please check and sign again.

[zhenhu]

please test workflow 140.56,140.57

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/31312/console Started: 2018/10/26 20:28

[cmsbuild]

+1
Tested at: 2b5c092
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25005/31312/summary.html

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25005/31312/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

• /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-25005/140.56_RunHI2018+RunHI2018+RECOHID18+HARVESTDHI18
• /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-25005/140.57_RunHI2018Reduced+RunHI2018Reduced+RECOHID18+HARVESTDHI18

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 4 differences found in the comparisons
• DQMHistoTests: Total files compared: 32
• DQMHistoTests: Total histograms compared: 2994843
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2994645
• DQMHistoTests: Total skipped: 197
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
• Checked 134 log files, 14 edm output root files, 32 DQM output files

[zhenhu]

+1

[zhenhu]

@zhenhu thank you a lot, I would like to see the final test once the samples are repacked and available in eos, I assume this should happen in the week end

Hi @fabiocos and @kpedro88 , the final test with RAW input from DAS is also successful. Could you please review and sign it again?

[fabiocos]

+1

[fabiocos]

merge

@kpedro88 the only change compared to your signature is the version of the input, please sign it in case again for reference

[kpedro88]

+upgrade

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will be automatically merged.