Add test for cross-site catalog access

[makortel]

PR description:

While investigating https://ggus.eu/index.php?mode=ticket_info&ticket_id=160073 I realized we didn't have a test for the cross-site catalog access (that is used in the wild at least for specifying the xrootd fallback). This PR adds such a test.

PR validation:

Unit test succeeds.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40569/33809

• This PR adds an extra 16KB to repository

[cmsbuild]

A new Pull Request was created by @makortel (Matti Kortelainen) for master.

It involves the following packages:

• FWCore/Catalog (core)
• FWCore/Services (core)

@cmsbuild, @smuzaffar, @Dr15Jones, @makortel can you please review it and eventually sign? Thanks.
@missirol, @wddgit, @fwyzard this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

[makortel]

@cmsbuild, please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6b3d29/30079/summary.html
COMMIT: 0715cf0
CMSSW: CMSSW_13_0_X_2023-01-19-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/40569/30079/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 8 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3555479
• DQMHistoTests: Total failures: 3
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3555454
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 211 log files, 162 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[makortel]

@Dr15Jones Could you take a look?

[Dr15Jones]

My only comment is I'd prefer if the various 'site' files were in a separate sub-directory of test just to keep the test directory less cluttered.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40569/33899

• This PR adds an extra 12KB to repository

• Found files with invalid states:

  • FWCore/Services/test/dummy_storage.json:
    • Added: 0715cf0
    • Deleted: 01c6300
  • FWCore/Services/test/cross-site-local-config.testfile:
    • Added: 0715cf0
    • Deleted: 01c6300
  • FWCore/Services/test/dummycross_storage.json:
    • Added: 0715cf0
    • Deleted: 01c6300

[cmsbuild]

Pull request #40569 was updated. @cmsbuild, @smuzaffar, @Dr15Jones, @makortel can you please check and sign again.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40569/33901

• This PR adds an extra 20KB to repository

• Found files with invalid states:

  • FWCore/Services/test/dummy_storage.json:
    • Added: 5510d0d
    • Deleted: 11bcbf5
  • FWCore/Services/test/cross-site-local-config.testfile:
    • Added: 5510d0d
    • Deleted: 11bcbf5
  • FWCore/Services/test/dummycross_storage.json:
    • Added: 5510d0d
    • Deleted: 11bcbf5

[cmsbuild]

Pull request #40569 was updated. @cmsbuild, @smuzaffar, @Dr15Jones, @makortel can you please check and sign again.

[makortel]

@cmsbuild, please test

Organized the files better.

[cmsbuild]

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6b3d29/30194/summary.html
COMMIT: 11bcbf5
CMSSW: CMSSW_13_0_X_2023-01-26-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/40569/30194/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

The relvals timed out after 4 hours.

Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3555495
• DQMHistoTests: Total failures: 0
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3555473
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 211 log files, 162 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[makortel]

+1

RelVals-INPUT tests timed out, nothing in this PR can impact those (and I'm leaning towards retesting not being worth it).

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (but tests are reportedly failing). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

[perrotta]

+1

[perrotta]

merge