[10.3.X] Introduce a special AlCaReco for Strip Small Bias Scans

[mmusich]

Greetings,
in the Tracker DPG we are trying to find a systematic solution to the chronic lack of RECO data-tier to analyze the output of SiStrip (small) Bias scans.
These scans are not affecting physics (so they are standard production runs) and therefore normally only standard AOD output is available for the high rate (ie. non commissioning) datasets, which is not enough for the sensor aging monitoring purposes.
A viable solution would be to run one of our ALCARECO producers saving tracks and Strip clusters , but this solution might be in general disfavored due to concerns about output dataset size.
Since we are scanning only few (fixed) power groups in a small bias scan and we are interested only in the clusters of tracks that have at least one hit on one of the modules being scanned, and we could select the output tracks to drastically reduce the data throughput.
This is what has been implemented in the PR.
A new track selector CalibrationTrackSelectorFromDetIdList, allowing to save a collection of track candidates leaving hits through a certain list of Tracker modules is employed in the novel SiStripCalSmallBiasScan ALCARECO producer.
The new ALCARECO producer has been added to several 2018 matrix workflows, including wf 136.85 which is in the short list used in PR tests.
To allow the ALCARECO producer to run I have changed the AlCaRecoTriggerBits in the run2_data_relval and run2_data_promptlike autoCond keys with temporary candidate GTs.
@lpernie @arunhep @tocheng you might want to change them into full-fledged Global Tags.
I report here for completeness the average compressed size in bytes/event of the branches of the new ALCARECO compared with SiStripCalMinBias.

Branch name	SiStripCalMinBias	SiStripCalSmallBiasScan
recoTrackExtras	39791	1982.09
TrackingRecHitsOwned	27896.9	1505.75
recoTracks	24399.7	1160.07
SiStripClusteredmNewDetSetVector	22430.6	1043.46
SiPixelClusteredmNewDetSetVector	13553.5	1001.83
LumiScalerss_scalersRawToDigi	1179.33	951.02
EventProductProvenance	1004.8	786.41
DcsStatuss	349.09	310.52
L1AcceptBunchCrossings	217.85	196.37
edmTriggerResults	192.13	181.04
DetIdedmEDCollection	158.74	144.52
edmTriggerResults	127.18	118.99
edmTriggerResults	71.18	63.34
L1GlobalTriggerReadoutRecord	63.36	56.98
EventAuxiliary	56.24	52.17
EventSelections	28.55	24.4
BranchListIndexes	17.88	15.5

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-24383/6155

[cmsbuild]

A new Pull Request was created by @mmusich (Marco Musich) for master.

It involves the following packages:

Calibration/TkAlCaRecoProducers
Configuration/AlCa
Configuration/EventContent
Configuration/PyReleaseValidation
Configuration/StandardSequences

@cmsbuild, @prebello, @zhenhu, @arunhep, @tocheng, @fabozzi, @pgunnell, @franzoni, @kpedro88, @GurpreetSinghChahal, @pohsun, @davidlange6, @fabiocos, @lpernie can you please review it and eventually sign? Thanks.
@makortel, @felicepantaleo, @GiacomoSguazzoni, @rovere, @VinInn, @Martin-Grunewald, @tocheng, @mmusich, @threus, @dgulhan this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

[davidlange6]

please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/30046/console Started: 2018/08/24 18:43

[cmsbuild]

+1
Tested at: 3d01094
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24383/30046/summary.html

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24383/30046/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 31
• DQMHistoTests: Total histograms compared: 2987459
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2987268
• DQMHistoTests: Total skipped: 190
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.023 KiB( 30 files compared)
• DQMHistoSizes: changed ( 136.85 ): 0.012 KiB MessageLogger/Errors
• DQMHistoSizes: changed ( 136.85 ): 0.012 KiB MessageLogger/Warnings
• Checked 129 log files, 14 edm output root files, 31 DQM output files

[cmsbuild]

+1
Tested at: 5a8be21
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24383/30135/summary.html

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
5a8be21
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24383/30135/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24383/30135/git-merge-result

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24383/30135/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 32
• DQMHistoTests: Total histograms compared: 3143879
• DQMHistoTests: Total failures: 2
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3143680
• DQMHistoTests: Total skipped: 197
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.023 KiB( 31 files compared)
• DQMHistoSizes: changed ( 136.85 ): 0.012 KiB MessageLogger/Errors
• DQMHistoSizes: changed ( 136.85 ): 0.012 KiB MessageLogger/Warnings
• Checked 133 log files, 14 edm output root files, 32 DQM output files

[tocheng]

+1

[kpedro88]

+upgrade

[mmusich]

Hi @prebello, you were OK with the changes here. Can you sign again (we changed only GT in the meanwhile)?

[prebello]

+1

[fabiocos]

+operations

the update of the StandardSequences looks correct and coherent with the purpose of this PR

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

[fabiocos]

+1