Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[URGENT] fix for getting clang version which is breaking 11.1.0.pre3 release #28947

Merged
merged 1 commit into from Feb 13, 2020

Conversation

smuzaffar
Copy link
Contributor

@smuzaffar smuzaffar commented Feb 13, 2020

PR description:

11.1.0.pre3 build are failing with error [a]. Looks like, while building release, clang returns something like

clang --version | grep 'clang version'
clang version 9.0.1 (/data/cmsbld/jenkins/workspace/auto-builds/CMSSW_11_1_0_pre3-slc7_amd64_gcc900/build/CMSSW_11_1_0_pre3-build/BUILD/slc7_amd64_gcc900/external/llvm/9.0.1/llvm-9.0.1-379a43bc841451feccf78db64f2ed5c9e62c7de8/clang 9979c02b51651889403625605dbd1409249d29fd)

note the extra (...) part which breaks condformats_serialization_generate.py. No idea why it is not failing for IBs where clang properly returns

>pwd
/build/muz/d/CMSSW_11_1_X_2020-02-12-2300
>clang --version | grep 'clang version'
clang version 9.0.1

this change makes sure that we only process the first part of version starting. We need to get this in as soon as possible to get going with 11.1.0.pre3 build

[a]

File ".../CMSSW_11_1_0_pre3/src/CondFormats/Serialization/python/condformats_serialization_generate.py", line 355, in get_clang_version
(clang_version_major, clang_version_minor, clang_version_patchlevel) = subprocess.check_output(command, shell=True).splitlines()[0].decode('ascii').strip().split('.', 3) ValueError: too many values to unpack

@smuzaffar
Copy link
Contributor Author

please test

@cmsbuild
Copy link
Contributor

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28947/13760

  • This PR adds an extra 8KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 13, 2020

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/4636/console Started: 2020/02/13 08:48

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @smuzaffar (Malik Shahzad Muzaffar) for master.

It involves the following packages:

CondFormats/Serialization

@ggovi, @cmsbuild can you please review it and eventually sign? Thanks.
@mmusich, @seemasharmafnal this is something you requested to watch as well.
@davidlange6, @silviodonato, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@silviodonato
Copy link
Contributor

urgent
thanks @smuzaffar for the quick fix!

@cmsbuild
Copy link
Contributor

+1
Tested at: 81ae544
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-717203/4636/summary.html
CMSSW: CMSSW_11_1_X_2020-02-12-2300
SCRAM_ARCH: slc7_amd64_gcc820

@cmsbuild
Copy link
Contributor

Comparison job queued.

@silviodonato
Copy link
Contributor

merge

@silviodonato
Copy link
Contributor

I wanted this fix in the next IB

@cmsbuild cmsbuild merged commit 5d6b994 into master Feb 13, 2020
@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-717203/4636/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2694005
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2693658
  • DQMHistoTests: Total skipped: 346
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

@smuzaffar smuzaffar deleted the smuzaffar-patch-3 branch February 13, 2020 13:35
@smuzaffar
Copy link
Contributor Author

smuzaffar commented Feb 18, 2020

@fwyzard , Patatrack IBs are failing [a] . I think you are missing this update in Patatrack .

[a]

Traceback (most recent call last):
  File "CMSSW_11_1_Patatrack_X_2020-02-17-2300/src/CondFormats/Serialization/python/condformats_serialization_generate.py", line 604, in <module>
    main()
  File "CMSSW_11_1_Patatrack_X_2020-02-17-2300/src/CondFormats/Serialization/python/condformats_serialization_generate.py", line 601, in main
    SerializationCodeGenerator( scramFlags=args[1:] ).generate( opts.output )
  File "CMSSW_11_1_Patatrack_X_2020-02-17-2300/src/CondFormats/Serialization/python/condformats_serialization_generate.py", line 508, in __init__
    self.classes = get_serializable_classes_members(translation_unit.cursor, only_from_path=self._join_package_path())
  File "CMSSW_11_1_Patatrack_X_2020-02-17-2300/src/CondFormats/Serialization/python/condformats_serialization_generate.py", line 203, in get_serializable_classes_members
    if not is_friend_decl(member.kind):
  File "CMSSW_11_1_Patatrack_X_2020-02-17-2300/src/CondFormats/Serialization/python/condformats_serialization_generate.py", line 362, in is_friend_decl
    clangv = get_clang_version()
  File "CMSSW_11_1_Patatrack_X_2020-02-17-2300/src/CondFormats/Serialization/python/condformats_serialization_generate.py", line 355, in get_clang_version
    (clang_version_major, clang_version_minor, clang_version_patchlevel) = subprocess.check_output(command, shell=True).splitlines()[0].decode('ascii').strip().split('.', 3)
  ValueError: too many values to unpack

@fwyzard
Copy link
Contributor

fwyzard commented Feb 18, 2020

Is it because the Patatrack IBs get the latest version of the externals, even though they do not get the CMSSW updates ?

@smuzaffar
Copy link
Contributor Author

smuzaffar commented Feb 18, 2020

yes, Patatrack uses the same externals we use for building normal 11.1.x IBs

fwyzard pushed a commit to cms-patatrack/cmssw that referenced this pull request Feb 21, 2020
@fwyzard
Copy link
Contributor

fwyzard commented Feb 21, 2020

OK, I've backported the fix to the patatrack branch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants