Upating HCAL validation test for HTCondor batch submission

[abdoulline]

Widely used HCAL validation test is updated to use HTCondor for submitting batch jobs.
No any central workflow's affected.

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-25678/8023

• This PR adds an extra 16KB to repository

[cmsbuild]

A new Pull Request was created by @abdoulline (Salavat Abdullin) for master.

It involves the following packages:

Validation/CaloTowers

@kmaeshima, @cmsbuild, @andrius-k, @jfernan2, @schneiml can you please review it and eventually sign? Thanks.
@hatakeyamak this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

[hatakeyamak]

Hi @abdoulline
It's not critical, but we are missing merging_cfi.py in Validation/CaloTowers/test/CaloScan/ ?

Thank you for making these changes by the way.

[cmsbuild]

The code-checks are being triggered in jenkins.

[abdoulline]

Hi @hatakeyamak
Thank you for spotting this omission.
Indeed, somehow it wasn't included in the previous PR. I've just added it.

[hatakeyamak]

Thank you. I just noticed about this missing file when I ran this workflow last time.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-25678/8027

• This PR adds an extra 16KB to repository

[cmsbuild]

Pull request #25678 was updated. @kmaeshima, @cmsbuild, @andrius-k, @jfernan2, @schneiml can you please check and sign again.

[andrius-k]

please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/32645/console Started: 2019/01/16 15:20

[cmsbuild]

+1
Tested at: a899789
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25678/32645/summary.html

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25678/32645/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 32
• DQMHistoTests: Total histograms compared: 3097440
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3097242
• DQMHistoTests: Total skipped: 197
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
• Checked 133 log files, 14 edm output root files, 32 DQM output files

[andrius-k]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

[fabiocos]

@abdoulline for my info, was this effectively tested on HTCondor?

[abdoulline]

Yes, first it was made work and then committed. Here is the test (HTCondor results vs regular LSF ones) : https://cms-cpt-software.web.cern.ch/cms-cpt-software/General/Validation/SVSuite/HCAL/calo_scan_single_pi/10_X/10_4_0_pre4_testCondor1_vs_10_4_0_pre4_SinglePi/

…

On Thu, 17 Jan 2019, Fabio Cossutti wrote: @abdoulline for my info, was this effectively tested on HTCondor? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.[AEx02gzvIgwXsoSGGxBhzxgCAnCoP9DDks5vEGDFgaJpZM4aCXmY.gif]

[fabiocos]

+1