Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SimTrack to CSC digi and stub matching in CSC Validation code #29139

Merged
merged 4 commits into from Mar 12, 2020
Merged

SimTrack to CSC digi and stub matching in CSC Validation code #29139

merged 4 commits into from Mar 12, 2020

Conversation

dildick
Copy link
Contributor

@dildick dildick commented Mar 6, 2020

PR description:

This PR builds on top of #26249 and #29042. This code matches CSC wire/strip/comparator digis and ALCT/CLCT/LCT stubs to SimTracks.

Tao Huang and I have been developing this validation code since ~2013 and have been using it in our trigger studies for the GEM TDR, Muon Phase-II TP, Muon Upgrade TDR. Most recently in the L1T TDR (https://cms-docdb.cern.ch/cgi-bin/DocDB/RetrieveFile?docid=13929&filename=TDR-20-001-paper-v1.pdf&version=4, section 2.5.5).

PR validation:

The code was tested with WF 22034.0.

if this PR is a backport please specify the original PR and why you need to backport that PR:

N/A

FYI @tahuang1991

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 6, 2020

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 6, 2020

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-29139/14065

  • This PR adds an extra 32KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 6, 2020

A new Pull Request was created by @dildick (Sven Dildick) for master.

It involves the following packages:

Validation/MuonCSCDigis

@andrius-k, @kmaeshima, @schneiml, @cmsbuild, @jfernan2, @fioriNTU can you please review it and eventually sign? Thanks.
@davidlange6, @silviodonato, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@civanch
Copy link
Contributor

civanch commented Mar 7, 2020

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 7, 2020

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/5057/console Started: 2020/03/07 20:58

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 7, 2020

+1
Tested at: f62e29a
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a8625f/5057/summary.html
CMSSW: CMSSW_11_1_X_2020-03-07-1100
SCRAM_ARCH: slc7_amd64_gcc820

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 7, 2020

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 7, 2020

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a8625f/5057/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 6 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2680577
  • DQMHistoTests: Total failures: 41
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2680217
  • DQMHistoTests: Total skipped: 319
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

@jfernan2
Copy link
Contributor

jfernan2 commented Mar 8, 2020

@dildick You are not enabling the code in any py config file, so no plots are produced, is this intentional? Thanks

@dildick
Copy link
Contributor Author

dildick commented Mar 9, 2020

@jfernan2 Yes, for now I'm not adding plots to the validation package yet.

@dildick
Copy link
Contributor Author

dildick commented Mar 9, 2020

In a next PR, I want to add efficiency plots for wire digi, comparator digi, ALCT, CLCT and LCT. Not all plots necessarily have to be made for each validation. Some - perhaps even most - should be made for expert studies for the CSC local trigger emulator.

@jfernan2
Copy link
Contributor

jfernan2 commented Mar 9, 2020

+1

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a8625f/5098/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2680577
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2680257
  • DQMHistoTests: Total skipped: 319
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

@jfernan2
Copy link
Contributor

+1
No changes as expected

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @silviodonato, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@silviodonato
Copy link
Contributor

please test workflow 23234.1001, 23434.1001

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 11, 2020

The tests are being triggered in jenkins.
Test Parameters:

@cmsbuild
Copy link
Contributor

+1
Tested at: 20f30fb
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a8625f/5128/summary.html
CMSSW: CMSSW_11_1_X_2020-03-10-2300
SCRAM_ARCH: slc7_amd64_gcc820

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a8625f/5128/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-a8625f/23234.1001_TTbar_14TeV+RecoFullGlobal_TestOldDigi_2026D49+HARVESTFullGlobal_2026D49
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-a8625f/23434.1001_TTbar_14TeV+RecoFullGlobalPU_TestOldDigi_2026D49PU+HARVESTFullGlobalPU_2026D49PU

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2680577
  • DQMHistoTests: Total failures: 2
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2680256
  • DQMHistoTests: Total skipped: 319
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

@silviodonato
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 15b1637 into cms-sw:master Mar 12, 2020
@dildick dildick deleted the from-CMSSW_11_1_X_2020-03-05-1100-CSC-Digi-Matching branch March 17, 2020 13:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants