Merger producer with Duplicate Removal Backport from CMSSW_11

[laurenhay]

Unique Merger 10_6_5 pull request:

PR description:

A new merger is cloned starting from the original Merger producer: it allows merging without duplicates and provides sorted collections, for future usage in some JME workflows.

PR validation:

These are new files; they effect no existing workflows. These files have been tested on the NanoAODJMAR workflows and are working as intended.
Test workflow is:

cmsrel CMSSW_10_6_X_2020-06-19-2300   
cd CMSSW_10_6_X_2020-06-19-2300/src/
git cms-init
git cms-addpkg PhysicsTools/NanoAOD
git cms-merge-topic laurenhay:uniquemerger_10_6_X
git clone https://github.com/cms-jet/NanoAODJMAR.git PhysicsTools/NanoAODJMAR
scram b -j 10
cd PhysicsTools/NanoAODJMAR/test
cmsRun nano106X_on_mini106X_2017_mc_NANO.py

If this PR is a backport please specify the original PR and why you need to backport that PR:

This merger has already been integrated into CMSSW_11 (see pull requests #29550 and #30251). We need to backport to CMSSW_10_6_X since the mentioned NanoAODJMAR is based upon NanoAODv6 and according to XPOG recommendations should be run in CMSSW_10_6_5.

@rappoccio

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-30424/16498

• This PR adds an extra 16KB to repository

[cmsbuild]

A new Pull Request was created by @laurenhay for CMSSW_10_6_X.

It involves the following packages:

CommonTools/CandAlgos
CommonTools/UtilAlgos

@perrotta, @cmsbuild, @santocch, @slava77 can you please review it and eventually sign? Thanks.
@makortel this is something you requested to watch as well.
@silviodonato, @dpiparo you are the release manager for this.

cms-bot commands are listed here

• Backported from Creating merger call with duplicate removal. #29550

[slava77]

@cmsbuild please test

[cmsbuild]

The tests are being triggered in jenkins.

• CMSSW_10_6_X_2020-06-25-1100/slc7_amd64_gcc700: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/7413/console Started: 2020/06/25 23:02

[cmsbuild]

+1
Tested at: b2fcf5f
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-1a1e6f/7413/summary.html
CMSSW: CMSSW_10_6_X_2020-06-25-1100
SCRAM_ARCH: slc7_amd64_gcc700

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-1a1e6f/7413/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 4 differences found in the comparisons
• DQMHistoTests: Total files compared: 33
• DQMHistoTests: Total histograms compared: 3212264
• DQMHistoTests: Total failures: 2
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3211928
• DQMHistoTests: Total skipped: 334
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 32 files compared)
• Checked 137 log files, 14 edm output root files, 33 DQM output files

[slava77]

backport of #29550
backport of #30251

[slava77]

+1

for #30424 b2fcf5f

• the backport is correct: the version of the three new file in this PR is the same as in the (merged) master version
  • the new merger instances are used for analysis at this point (or/and for nanoAOD)
• jenkins tests pass (compiles; the new code did not run in the tests)

[santocch]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_10_6_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_11_2_X is complete. This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo (and backports should be raised in the release meeting by the corresponding L2)

[silviodonato]

+1