Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use python3 in FWCore/ParameterSet unit tests #34493

Merged
merged 2 commits into from Jul 16, 2021

Conversation

makortel
Copy link
Contributor

PR description:

This PR is a continuation of #34477. It changes FWCore/ParameterSet unit tests to use python 3, and fixes all the remaining python3 issues in these tests.

Resolves #28703. Resolves cms-sw/framework-team#189.

PR validation:

Effectively tested in CMSSW_12_0_X_2021-07-12-2300 that these tests run with python 3.

@makortel
Copy link
Contributor Author

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-34493/23965

  • This PR adds an extra 84KB to repository

  • There are other open Pull requests which might conflict with changes you have proposed:

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @makortel (Matti Kortelainen) for master.

It involves the following packages:

  • FWCore/ParameterSet (core)

@makortel, @smuzaffar, @Dr15Jones can you please review it and eventually sign? Thanks.
@wddgit this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy, @perrotta you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

-1

Failed Tests: UnitTests RelVals RelVals-INPUT AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6a9d7b/16833/summary.html
COMMIT: c32380a
CMSSW: CMSSW_12_0_X_2021-07-14-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found errors in the following unit tests:

---> test TestFWCoreFrameworkTrigBit had ERRORS
---> test TestFWCoreFrameworkDeleteEarly had ERRORS
---> test TestIntegrationSeriesOfProcesses had ERRORS
---> test testPyDevParameterSet had ERRORS
and more ...

RelVals

----- Begin Fatal Exception 15-Jul-2021 03:08:57 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named TTbar_8TeV_TuneCUETP8M1_cfi_GEN_SIM_RECOBEFMIX_DIGI_L1_DIGI2RAW_L1Reco_RECO_EI_VALIDATION_DQM.py
Exception Message:
 unknown python problem occurred.
AttributeError: '_SequenceIgnore' object has no attribute 'type'

At:
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(562): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1172): _insertPaths
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1318): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 15-Jul-2021 03:09:00 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named ZEE_13TeV_TuneCUETP8M1_cfi_GEN_SIM_RECOBEFMIX_DIGI_L1_DIGI2RAW_L1Reco_RECO_EI_VALIDATION_DQM.py
Exception Message:
 unknown python problem occurred.
AttributeError: '_SequenceIgnore' object has no attribute 'type'

At:
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(562): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1172): _insertPaths
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1318): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 15-Jul-2021 03:09:16 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named step2_RAW2DIGI_L1Reco_RECO_ALCA_DQM.py
Exception Message:
 unknown python problem occurred.
AttributeError: '_SequenceNegation' object has no attribute 'type'

At:
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(562): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1172): _insertPaths
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1318): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
Expand to see more relval errors ...

RelVals-INPUT

  • 4.64.6_MinimumBias2010A+MinimumBias2010A+RECOSKIMALCA+HARVESTDR1/step2_MinimumBias2010A+MinimumBias2010A+RECOSKIMALCA+HARVESTDR1.log
  • 136.72411136.72411_RunJetHT2016B_reminiaodUL+RunJetHT2016B_reminiaodUL+REMINIAOD_data2016UL_HIPM+HARVESTDR2_REMINIAOD_data2016UL_HIPM/step2_RunJetHT2016B_reminiaodUL+RunJetHT2016B_reminiaodUL+REMINIAOD_data2016UL_HIPM+HARVESTDR2_REMINIAOD_data2016UL_HIPM.log
  • 136.76111136.76111_RunJetHT2016E_reminiaodUL+RunJetHT2016E_reminiaodUL+REMINIAOD_data2016UL_HIPM+HARVESTDR2_REMINIAOD_data2016UL_HIPM/step2_RunJetHT2016E_reminiaodUL+RunJetHT2016E_reminiaodUL+REMINIAOD_data2016UL_HIPM+HARVESTDR2_REMINIAOD_data2016UL_HIPM.log
Expand to see more relval errors ...

AddOn Tests

----- Begin Fatal Exception 15-Jul-2021 03:08:24 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named TTbar_8TeV_TuneCUETP8M1_cfi_GEN_SIM_RECOBEFMIX_DIGI_L1_DIGI2RAW_L1Reco_RECO_EI_VALIDATION.py
Exception Message:
 unknown python problem occurred.
AttributeError: '_SequenceIgnore' object has no attribute 'type'

At:
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(562): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1172): _insertPaths
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1318): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 15-Jul-2021 03:08:25 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named TTbar_13TeV_TuneCUETP8M1_cfi_GEN_SIM_RECOBEFMIX_DIGI_L1_DIGI2RAW_L1Reco_RECO_EI_VALIDATION.py
Exception Message:
 unknown python problem occurred.
AttributeError: '_SequenceIgnore' object has no attribute 'type'

At:
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(562): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1172): _insertPaths
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1318): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 15-Jul-2021 03:08:27 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named TTbar_13TeV_TuneCUETP8M1_cfi_GEN_SIM_RECOBEFMIX_DIGI_L1_DIGI2RAW_L1Reco_RECO_EI_VALIDATION.py
Exception Message:
 unknown python problem occurred.
AttributeError: '_SequenceIgnore' object has no attribute 'type'

At:
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(562): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): <listcomp>
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(189): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/SequenceTypes.py(503): resolve
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1172): _insertPaths
  /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16833/CMSSW_12_0_X_2021-07-14-1100/python/FWCore/ParameterSet/Config.py(1318): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------
Expand to see more addon errors ...

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-34493/23977

  • This PR adds an extra 84KB to repository

@cmsbuild
Copy link
Contributor

Pull request #34493 was updated. @makortel, @smuzaffar, @cmsbuild, @Dr15Jones can you please check and sign again.

@makortel
Copy link
Contributor Author

@cmsbuild, please test

@makortel
Copy link
Contributor Author

I extended the unit test so that the earlier problem would have been caught by the test. Now this should be good to go.

@makortel
Copy link
Contributor Author

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-34493/23998

  • This PR adds an extra 28KB to repository

@cmsbuild
Copy link
Contributor

Pull request #34493 was updated. @makortel, @smuzaffar, @Dr15Jones can you please check and sign again.

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6a9d7b/16863/summary.html
COMMIT: 6ca99d6
CMSSW: CMSSW_12_0_X_2021-07-15-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/34493/16863/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 38
  • DQMHistoTests: Total histograms compared: 2786302
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2786279
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 37 files compared)
  • Checked 160 log files, 37 edm output root files, 38 DQM output files
  • TriggerResults: no differences found

@makortel
Copy link
Contributor Author

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy, @perrotta (and backports should be raised in the release meeting by the corresponding L2)

@qliphy
Copy link
Contributor

qliphy commented Jul 16, 2021

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fix ParameterSet tests for python3 Ordering issue in Task.replace() affecting dumpPython()
4 participants