Extend jmalloc to monitor the peak memory usage of each thread (11.1.x)

[fwyzard]

See jemalloc/jemalloc#1176 and jemalloc/jemalloc#1850 for the discussion with the jemalloc development team.

[fwyzard]

backport #5852

[cmsbuild]

A new Pull Request was created by @fwyzard (Andrea Bocci) for branch IB/CMSSW_11_1_X/master.

@cmsbuild, @smuzaffar, @mrodozov, @tulamor can you please review it and eventually sign? Thanks.
cms-bot commands are listed here

• Backported from Extend jmalloc to monitor the peak memory usage of each thread (11.2.x) #5852

[fwyzard]

@cmsbuild, please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/6549/console Started: 2020/05/24 11:33

[cmsbuild]

+1
Tested at: 1516fd3
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-022e59/6549/summary.html
CMSSW: CMSSW_11_1_X_2020-05-23-1100
SCRAM_ARCH: slc7_amd64_gcc820

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-022e59/6549/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 4 differences found in the comparisons
• DQMHistoTests: Total files compared: 36
• DQMHistoTests: Total histograms compared: 2780792
• DQMHistoTests: Total failures: 54
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2780688
• DQMHistoTests: Total skipped: 50
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 35 files compared)
• Checked 152 log files, 16 edm output root files, 36 DQM output files

[smuzaffar]

please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/6706/console Started: 2020/05/30 11:12

[cmsbuild]

Pull request #5853 was updated.

[cmsbuild]

+1
Tested at: 76f4f87
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-022e59/6706/summary.html
CMSSW: CMSSW_11_1_X_2020-05-29-2300
SCRAM_ARCH: slc7_amd64_gcc820

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-022e59/6706/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 2 differences found in the comparisons
• DQMHistoTests: Total files compared: 36
• DQMHistoTests: Total histograms compared: 2780792
• DQMHistoTests: Total failures: 50
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2780692
• DQMHistoTests: Total skipped: 50
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 35 files compared)
• Checked 152 log files, 16 edm output root files, 36 DQM output files

[smuzaffar]

+externals

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_11_1_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo (and backports should be raised in the release meeting by the corresponding L2)

[smuzaffar]

@silviodonato , this can go in 11.1.X . Feel free to merge.

[silviodonato]

+1