[10_6_X] MXNet-based implementation of the ParticleNet tagger

[hqucms]

Backport of #28902.

Currently the ParticleNet tagger is not added to the MiniAOD sequence. But we plan to enable it for UL re-MiniAOD.

Needs:

• DNN model: DNN models for the ParticleNet tagger cms-data/RecoBTag-Combined#26
• MXNet 1.5: [10.6.X] Update MXNet to 1.5.0 cmsdist#5592

We should also integrate cms-data/RecoBTag-Combined#24 together with the update to MXNet 1.5.

[cmsbuild]

A new Pull Request was created by @hqucms (Huilin Qu) for CMSSW_10_6_X.

It involves the following packages:

PhysicsTools/PatAlgos
RecoBTag/Configuration
RecoBTag/FeatureTools
RecoBTag/MXNet

@perrotta, @cmsbuild, @santocch, @slava77 can you please review it and eventually sign? Thanks.
@rappoccio, @gouskos, @hatakeyamak, @emilbols, @peruzzim, @seemasharmafnal, @mmarionncern, @ahinzmann, @smoortga, @jdolen, @ferencek, @jdamgov, @nhanvtran, @gkasieczka, @schoef, @andrzejnovak, @clelange, @riga, @JyothsnaKomaragiri, @mverzett, @gpetruc, @mariadalfonso this is something you requested to watch as well.
@davidlange6, @silviodonato, @fabiocos you are the release manager for this.

cms-bot commands are listed here

[cmsbuild]

Pull request #29062 was updated. @perrotta, @cmsbuild, @santocch, @slava77 can you please check and sign again.

[slava77]

test parameters

• pull_request = [10.6.X] apply RecoBTag-Combined=V01-03-00 for 106X cmsdist#5717

[slava77]

Currently the ParticleNet tagger is not added to the MiniAOD sequence. But we plan to enable it for UL re-MiniAOD.

if this is planned for UL, please add the tagger via run2_miniAOD_devel

[slava77]

@cmsbuild please test

[cmsbuild]

The tests are being triggered in jenkins.
Tested with other pull request(s) cms-sw/cmsdist#5717
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/5569/console Started: 2020/04/07 18:44

[cmsbuild]

+1
Tested at: 7af0d67
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-84e2b8/5569/summary.html
CMSSW: CMSSW_10_6_X_2020-04-07-1100
SCRAM_ARCH: slc7_amd64_gcc700

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-84e2b8/5569/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 33
• DQMHistoTests: Total histograms compared: 3212324
• DQMHistoTests: Total failures: 31
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3211959
• DQMHistoTests: Total skipped: 334
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 32 files compared)
• Checked 137 log files, 14 edm output root files, 33 DQM output files

[santocch]

+1

[slava77]

test parameters

• pull_request =

[slava77]

@cmsbuild please test

[cmsbuild]

The tests are being triggered in jenkins.
Tested with other pull request(s) cms-sw/cmsdist#5717
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/5702/console Started: 2020/04/15 15:10

[slava77]

Tested with other pull request(s) cms-sw/cmsdist#5717

@smuzaffar I thought that doing as in #29062 (comment) I would get the extra requirements reset.

test parameters

* pull_request =

What it the right way to reset the extras?

[cmsbuild]

+1
Tested at: d6a8740
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-84e2b8/5702/summary.html
CMSSW: CMSSW_10_6_X_2020-04-15-1100
SCRAM_ARCH: slc7_amd64_gcc700

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-84e2b8/5702/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 33
• DQMHistoTests: Total histograms compared: 3212324
• DQMHistoTests: Total failures: 43
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3211947
• DQMHistoTests: Total skipped: 334
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 32 files compared)
• Checked 137 log files, 14 edm output root files, 33 DQM output files

[slava77]

+1

for #29062 d6a8740

• code changes are in line with the PR description and the follow up review. The backport is a bit closer to the master version than the 10_2_X, but it's still fairly close to the [10_2_X] MXNet-based implementation of the ParticleNet tagger #29063 .
  • The new code is enabled with run2_miniAOD_devel and otherwise does not affect the production workflows.
• jenkins tests pass and comparisons with the baseline show no (relevant) differences
• I checked locally with run2_miniAOD_devel added to wfs 1325.7 and 136.8311 to confirm that the particleNet taggers run and that the values are consistent with the tagger results in the master version (on 1000 events there were no differences above 1E-4 level relative, compared to the tag results in 11_1_0_pre5; I'm taking this as close enough for a validation for physics purpose as well).

[silviodonato]

do you have comments @santocch?

[santocch]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_10_6_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_11_1_X is complete. This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo (and backports should be raised in the release meeting by the corresponding L2)

[silviodonato]

+1