Improvements for upgrade matrix (81X)

[kpedro88]

Backport of #16665

[cmsbuild]

A new Pull Request was created by @kpedro88 (Kevin Pedro) for CMSSW_8_1_X.

It involves the following packages:

Configuration/Generator
Configuration/PyReleaseValidation

@perrozzi, @thuer, @fabozzi, @cmsbuild, @srimanob, @govoni, @hengne, @davidlange6 can you please review it and eventually sign? Thanks.
@ghellwig, @makortel, @Martin-Grunewald this is something you requested to watch as well.
@slava77, @smuzaffar you are the release manager for this.

cms-bot commands are listed here #13028

[kpedro88]

@cmsbuild please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/16392/console

[cmsbuild]

+1
Tested at: d0a73c6
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16666/16392/summary.html

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
58f4ff3
57a74ee
d2f7bcb
e796093
0ceca72
902b422
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16666/16392/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16666/16392/git-merge-result

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16666/16392/summary.html

[govoni]

+1

[hengne]

+1

[kpedro88]

@cmsbuild please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/16488/console

[cmsbuild]

+1
Tested at: 28235d9
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16666/16488/summary.html

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16666/16488/summary.html

[hengne]

+1

[perrozzi]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_8_1_X IBs (tests are also fine). This pull request requires discussion in the ORP meeting before it's merged. @slava77, @davidlange6, @smuzaffar

[iahmad-khan]

@kpedro88 the new workflows are failing. 23621.0 , 23634.0 , 23646.0 , 23653.0 in 81x.

https://cms-sw.github.io/relvalLogDetail.html#slc6_amd64_gcc530;CMSSW_8_1_X_2016-11-27-2300

GEN,SIM,ENDJOB
We have determined that this is simulation (if not, rerun cmsDriver.py with --data)
Step: GEN Spec: 
Loading generator fragment from Configuration.Generator.TenMuE_0_200_pythia8_cfi
Step: SIM Spec: 
Step: ENDJOB Spec: 
customising the process with cust_2023tilted from SLHCUpgradeSimulations/Configuration/combinedCustoms
Traceback (most recent call last):
  File "/cvmfs/cms-ib.cern.ch/2016-49/slc6_amd64_gcc530/cms/cmssw/CMSSW_8_1_X_2016-11-27-2300/bin/slc6_amd64_gcc530/cmsDriver.py", line 55, in <module>
    run()
  File "/cvmfs/cms-ib.cern.ch/2016-49/slc6_amd64_gcc530/cms/cmssw/CMSSW_8_1_X_2016-11-27-2300/bin/slc6_amd64_gcc530/cmsDriver.py", line 27, in run
    configBuilder.prepare()
  File "/cvmfs/cms-ib.cern.ch/2016-49/slc6_amd64_gcc530/cms/cmssw/CMSSW_8_1_X_2016-11-27-2300/python/Configuration/Applications/ConfigBuilder.py", line 2192, in prepare
    self.pythonCfgCode += self.addCustomise()
  File "/cvmfs/cms-ib.cern.ch/2016-49/slc6_amd64_gcc530/cms/cmssw/CMSSW_8_1_X_2016-11-27-2300/python/Configuration/Applications/ConfigBuilder.py", line 873, in addCustomise
    raise Exception("config "+f+" has no function "+fcn)
Exception: config SLHCUpgradeSimulations/Configuration/combinedCustoms has no function cust_2023tilted

Maye be it has problem with. #16385

[makortel]

This was fixed for 90X in #16682. (feel free to backport)

[iahmad-khan]

@kpedro88 can you please make a PR for 81x ( backport of #16682 )

[kpedro88]

submitted #16781