add unit test to check availability of EDM files used in HLT tests

[missirol]

PR description:

The PRs to fix #40013 updated the HLT tests to use the standard LFNs of their EDM input files. This failed to cover one use case of TSG: running locally an extended version of the HLT tests which requires access to EDM files not used in IBs of any release cycles. Since these files are not used in IBs, they might eventually be removed from the IB-EOS cache, causing said local tests to fail if the EDM files are not available at any other T2/T3.

This PR adds a unit test which accesses each of the EDM files needed for (the extended version of the) HLT tests. In practise, this serves as a trick to ensure that the cmsbot keeps these files cached in the IB-EOS area. The list of relevant EDM files is maintained in a text file, which can be updated by locally executing a script (the unit test does not modify the text file with the list of EDM files, it only uses it). A readme with further details is added under test/.

PR validation:

The new unit test passes.

If this PR is a backport, please specify the original PR and why you need to backport that PR. If this PR will be backported, please specify to which release cycle the backport is meant for:

N/A

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40365/33464

• This PR adds an extra 20KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File HLTrigger/Configuration/test/cmsDriver.csh modified in PR(s): Add more HLT menu tests to HLT validation tests #40236

[cmsbuild]

A new Pull Request was created by @missirol (Marino Missiroli) for master.

It involves the following packages:

• HLTrigger/Configuration (hlt)

@cmsbuild, @missirol, @Martin-Grunewald can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @silviodonato this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

[missirol]

please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-8b25b8/29695/summary.html
COMMIT: 4c2fe56
CMSSW: CMSSW_13_0_X_2022-12-19-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/40365/29695/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

There are some workflows for which there are errors in the baseline:
20034.61 step 5
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

Summary:

• No significant changes to the logs found
• Reco comparison results: 29 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3555748
• DQMHistoTests: Total failures: 1188
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3554538
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 211 log files, 162 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40365/33475

• This PR adds an extra 20KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File HLTrigger/Configuration/test/cmsDriver.csh modified in PR(s): Add more HLT menu tests to HLT validation tests #40236

[cmsbuild]

Pull request #40365 was updated. @cmsbuild, @missirol, @Martin-Grunewald can you please check and sign again.

[missirol]

please test

[missirol]

please test

its implementation might be improved in the future.

The latest push includes some improvements to the update_filelist script (mainly, formatting changes). This latest update won't have any impact on PR tests (which will be repeated nonetheless). I don't plan to make further changes to this PR.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40365/33483

• This PR adds an extra 20KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File HLTrigger/Configuration/test/cmsDriver.csh modified in PR(s): Add more HLT menu tests to HLT validation tests #40236

[cmsbuild]

Pull request #40365 was updated. @Martin-Grunewald, @missirol can you please check and sign again.

[cmsbuild]

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-8b25b8/29710/summary.html
COMMIT: 7b5e4e0
CMSSW: CMSSW_13_0_X_2022-12-19-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/40365/29710/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

The relvals timed out after 4 hours.

Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 6 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3555748
• DQMHistoTests: Total failures: 154
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3555572
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 211 log files, 162 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[missirol]

+hlt

The new unit test passes. The RelVals-INPUT error can't be related to this PR (by construction).

PS. Only a few RelVal-input wfs were missing when the 4h-timeout hit. I wonder if increasing this timeout limit a bit could decrease significantly the rate of these spurious errors.

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (but tests are reportedly failing). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

[perrotta]

+1

[perrotta]

merge