Moving externals towards python3

[davidlange6]

Move scons to python3
move several py2*spec files to py3 and pip
remove python2 from Yoda
add open loops patch (modified) from Shahzad

[cmsbuild]

A new Pull Request was created by @davidlange6 (David Lange) for branch IB/CMSSW_12_0_X/master.

@cmsbuild, @smuzaffar, @mrodozov, @iarspider can you please review it and eventually sign? Thanks.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.
cms-bot commands are listed here

[cmsbuild]

Pull request #7070 was updated.

[davidlange6]

please test

[smuzaffar]

@davidlange6 , this will fail to find TOOL_ROOT. Please rename scons-toolfile.spec to py3-scons-toolfile.spec so that https://github.com/cms-sw/cmsdist/blob/IB/CMSSW_12_0_X/master/scram-tools-post.file#L4 can properly find the TOOL_ROOT . Note that the xml file generated inside the py3-scons-toolfile.spec can remain the same.

[davidlange6]

Ah - right! - will do but I’ll see what else fails first..

…

On Jun 28, 2021, at 5:56 PM, Malik Shahzad Muzaffar ***@***.***> wrote: @smuzaffar commented on this pull request. In scons-toolfile.spec: > @@ -1,5 +1,5 @@ ### RPM external scons-toolfile 2.0 -Requires: scons +Requires: py3-scons @davidlange6 , this will fail to find TOOL_ROOT. Please rename scons-toolfile.spec to py3-scons-toolfile.spec so that https://github.com/cms-sw/cmsdist/blob/IB/CMSSW_12_0_X/master/scram-tools-post.file#L4 can properly find the TOOL_ROOT . Note that the xml file generated inside the py3-scons-toolfile.spec can remain the same. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

[cmsbuild]

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fff395/16286/summary.html
COMMIT: beb1c1b
CMSSW: CMSSW_12_0_X_2021-06-28-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7070/16286/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation warning when building: See details on the summary page.

[smuzaffar]

@davidlange6 , this should be 1.55

[cmsbuild]

Pull request #7070 was updated.

[davidlange6]

please test

[cmsbuild]

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fff395/16293/summary.html
COMMIT: 85b156f
CMSSW: CMSSW_12_0_X_2021-06-28-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7070/16293/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation warning when building: See details on the summary page.

[cmsbuild]

Pull request #7070 was updated.

[davidlange6]

please test

[smuzaffar]

please test for slc7_aarch64_gcc9

[smuzaffar]

please test for CMSSW_12_0_X/slc7_ppc64le_gcc9

[smuzaffar]

please test

[cmsbuild]

Pull request #7070 was updated.

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fff395/16324/summary.html
COMMIT: b5c43e9
CMSSW: CMSSW_12_0_X_2021-06-29-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7070/16324/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• [OpenLoops 2.1.2] Generate process_src.tgz to be uploaded as source #7066 @cms-sw: [OpenLoops 2.1.2] Generate process_src.tgz to be uploaded as source

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fff395/16324/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fff395/16324/git-merge-result

Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 6 differences found in the comparisons
• DQMHistoTests: Total files compared: 38
• DQMHistoTests: Total histograms compared: 2785711
• DQMHistoTests: Total failures: 13
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2785676
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 37 files compared)
• Checked 160 log files, 37 edm output root files, 38 DQM output files
• TriggerResults: no differences found

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fff395/16330/summary.html
COMMIT: b5c43e9
CMSSW: CMSSW_12_0_X_2021-06-29-1100/slc7_aarch64_gcc9
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7070/16330/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• [OpenLoops 2.1.2] Generate process_src.tgz to be uploaded as source #7066 @cms-sw: [OpenLoops 2.1.2] Generate process_src.tgz to be uploaded as source

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fff395/16330/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fff395/16330/git-merge-result

[smuzaffar]

+externals

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_12_0_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)