Update hdf5 to 1.10.6 #6087

mrodozov · 2020-07-16T13:53:01Z

please test

cmsbuild · 2020-07-16T13:53:23Z

The tests are being triggered in jenkins.

CMSSW_11_2_X_2020-07-15-2300/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/8005/console Started: 2020/07/16 15:57

cmsbuild · 2020-07-16T13:53:24Z

A new Pull Request was created by @mrodozov (Mircho Rodozov) for branch IB/CMSSW_11_2_X/master.

@cmsbuild, @smuzaffar, @mrodozov, @tulamor can you please review it and eventually sign? Thanks.
cms-bot commands are listed here

Dr15Jones · 2020-07-16T14:13:15Z

thanks!

cmsbuild · 2020-07-16T14:31:15Z

-1

Tested at: 6727130

Build:

I found compilation error when building:

File "/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/slc7_amd64_gcc820/external/py2-pip/9.0.3-bcolbf2/lib/python3.8/site-packages/pip/req/req_install.py", line 874, in install
call_subprocess(
File "/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/slc7_amd64_gcc820/external/py2-pip/9.0.3-bcolbf2/lib/python3.8/site-packages/pip/utils/__init__.py", line 705, in call_subprocess
raise InstallationError(
pip.exceptions.InstallationError: Command "/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/slc7_amd64_gcc820/external/python3/3.8.2-bcolbf/bin/python3 -u -c "import setuptools, tokenize;__file__='/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/pip-cn2xqk_8-build/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/pip-48gfg9kq-record/install-record.txt --single-version-externally-managed --compile --user --prefix=" failed with error code 1 in /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/pip-cn2xqk_8-build/
error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.EkHK3Q (%build)


RPM build errors:
Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.EkHK3Q (%build)

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5a26b1/8005/summary.html

mrodozov · 2020-07-16T14:54:08Z

oops

Dr15Jones · 2020-07-17T13:11:24Z

Any progress?

mrodozov · 2020-07-17T13:19:02Z

I'm building this on cmsdev24 to try fix the externals not building so, no, not much :/

smuzaffar · 2020-07-20T07:28:41Z

py2-h5py released version does not support hdf5 1.12.0 yet h5py/h5py#1560. You need to get master branch of https://github.com/h5py/h5py

mrodozov · 2020-07-20T11:05:23Z

update is I have built h5py for Python3, but from what I suspect from here:
h5py/h5py#1505
h5py is only available for Python3 now (no surprise if so)
This means keras and keras applications might need only be available for py3 , and all that depends on them, too (meaning tensorflow).
I'm building the entire cmsdist to check

According to h5py/h5py#1505 (comment) 1.10.6 is the latest one working with python2 Above that version only Python3 is supported, and for this we have to move also Keras and Keras-Applications to py3 only, and from there - have only py3 tensorflow.

mrodozov · 2020-07-20T14:51:32Z

please test

cmsbuild · 2020-07-20T14:51:46Z

The tests are being triggered in jenkins.

CMSSW_11_2_X_2020-07-20-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/8132/console Started: 2020/07/20 17:05

cmsbuild · 2020-07-20T14:51:48Z

Pull request #6087 was updated.

mrodozov · 2020-07-20T14:53:37Z

@Dr15Jones is 1.10.6 acceptable (Dec 2019) ? The other scenario might be ... clumsy . See the last commit comment

cmsbuild · 2020-07-20T15:31:51Z

-1

Tested at: b8131a1

Build:

I found compilation error when building:

-rw-rw-r-- root/root      1528 2019-12-24 22:12 hdf5-hdf5-1_10_6/tools/testfiles/zerodim.h5
+ STATUS=0
+ '[' 0 -ne 0 ']'
+ cd hdf5-1.10.6
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.JokZgg: line 39: cd: hdf5-1.10.6: No such file or directory
error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.JokZgg (%prep)


RPM build errors:
Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.JokZgg (%prep)

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5a26b1/8132/summary.html

mrodozov · 2020-07-20T20:51:35Z

test parameters:

release = CMSSW_11_2_X_2020-07-18-1100

mrodozov · 2020-07-20T20:51:52Z

please test

cmsbuild · 2020-07-20T20:52:21Z

The tests are being triggered in jenkins.
Test Parameters:

RELEASE_FORMAT = CMSSW_11_2_X_2020-07-18-1100
CMSSW_11_2_X_2020-07-18-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/8144/console Started: 2020/07/20 22:59

cmsbuild · 2020-07-21T01:28:37Z

+1
Tested at: 71483e2
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5a26b1/8144/summary.html
CMSSW: CMSSW_11_2_X_2020-07-18-1100
SCRAM_ARCH: slc7_amd64_gcc820

cmsbuild · 2020-07-21T01:28:40Z

Comparison job queued.

cmsbuild · 2020-07-21T03:10:20Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5a26b1/8144/summary.html

Comparison Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 34
DQMHistoTests: Total histograms compared: 2525996
DQMHistoTests: Total failures: 1
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2525948
DQMHistoTests: Total skipped: 47
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
Checked 144 log files, 17 edm output root files, 34 DQM output files

mrodozov · 2020-07-21T14:26:24Z

+externals

cmsbuild · 2020-07-21T14:26:44Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_11_2_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo (and backports should be raised in the release meeting by the corresponding L2)

silviodonato · 2020-07-22T06:20:58Z

+1

Update hdf5 to 1.12.0

6727130

please test

cmsbuild added comparison-pending externals-pending orp-pending pending-signatures tests-pending labels Jul 16, 2020

cmsbuild added tests-started and removed tests-pending labels Jul 16, 2020

cmsbuild added tests-rejected and removed tests-started labels Jul 16, 2020

Move to 1.10.6

b8131a1

According to h5py/h5py#1505 (comment) 1.10.6 is the latest one working with python2 Above that version only Python3 is supported, and for this we have to move also Keras and Keras-Applications to py3 only, and from there - have only py3 tensorflow.

cmsbuild added tests-pending and removed tests-rejected labels Jul 20, 2020

cmsbuild added tests-started and removed tests-pending labels Jul 20, 2020

cmsbuild removed the tests-started label Jul 20, 2020

cmsbuild added the tests-rejected label Jul 20, 2020

cmsbuild added comparison-pending tests-pending and removed comparison-notrun tests-rejected labels Jul 20, 2020

cmsbuild added tests-started and removed tests-pending labels Jul 20, 2020

cmsbuild added tests-approved and removed tests-started labels Jul 21, 2020

cmsbuild added comparison-available and removed comparison-pending labels Jul 21, 2020

mrodozov changed the title ~~Update hdf5 to 1.12.0~~ Update hdf5 to 1.10.6 Jul 21, 2020

cmsbuild added externals-approved fully-signed and removed externals-pending pending-signatures labels Jul 21, 2020

cmsbuild added orp-approved and removed orp-pending labels Jul 22, 2020

cmsbuild merged commit 15a3694 into IB/CMSSW_11_2_X/master Jul 22, 2020

smuzaffar deleted the mrodozov-patch-2 branch July 27, 2020 14:42

sabasehrish mentioned this pull request Jul 29, 2020

HDF5 1.10.6 with parallel support #6123

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update hdf5 to 1.10.6 #6087

Update hdf5 to 1.10.6 #6087

mrodozov commented Jul 16, 2020

cmsbuild commented Jul 16, 2020 •

edited

cmsbuild commented Jul 16, 2020

Dr15Jones commented Jul 16, 2020

cmsbuild commented Jul 16, 2020

mrodozov commented Jul 16, 2020

Dr15Jones commented Jul 17, 2020

mrodozov commented Jul 17, 2020

smuzaffar commented Jul 20, 2020

mrodozov commented Jul 20, 2020

mrodozov commented Jul 20, 2020

cmsbuild commented Jul 20, 2020 •

edited

cmsbuild commented Jul 20, 2020

mrodozov commented Jul 20, 2020 •

edited

cmsbuild commented Jul 20, 2020

mrodozov commented Jul 20, 2020

mrodozov commented Jul 20, 2020

cmsbuild commented Jul 20, 2020 •

edited

cmsbuild commented Jul 21, 2020

cmsbuild commented Jul 21, 2020

cmsbuild commented Jul 21, 2020

mrodozov commented Jul 21, 2020

cmsbuild commented Jul 21, 2020

silviodonato commented Jul 22, 2020

Update hdf5 to 1.10.6 #6087

Update hdf5 to 1.10.6 #6087

Conversation

mrodozov commented Jul 16, 2020

cmsbuild commented Jul 16, 2020 • edited

cmsbuild commented Jul 16, 2020

Dr15Jones commented Jul 16, 2020

cmsbuild commented Jul 16, 2020

mrodozov commented Jul 16, 2020

Dr15Jones commented Jul 17, 2020

mrodozov commented Jul 17, 2020

smuzaffar commented Jul 20, 2020

mrodozov commented Jul 20, 2020

mrodozov commented Jul 20, 2020

cmsbuild commented Jul 20, 2020 • edited

cmsbuild commented Jul 20, 2020

mrodozov commented Jul 20, 2020 • edited

cmsbuild commented Jul 20, 2020

mrodozov commented Jul 20, 2020

mrodozov commented Jul 20, 2020

cmsbuild commented Jul 20, 2020 • edited

cmsbuild commented Jul 21, 2020

cmsbuild commented Jul 21, 2020

cmsbuild commented Jul 21, 2020

mrodozov commented Jul 21, 2020

cmsbuild commented Jul 21, 2020

silviodonato commented Jul 22, 2020

cmsbuild commented Jul 16, 2020 •

edited

cmsbuild commented Jul 20, 2020 •

edited

mrodozov commented Jul 20, 2020 •

edited

cmsbuild commented Jul 20, 2020 •

edited