Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implementation of DQM plot: tracking efficiency VS dR(track, jet) #25514

Merged
merged 21 commits into from Feb 28, 2019

Conversation

vberta
Copy link
Contributor

@vberta vberta commented Dec 18, 2018

Implemented in tracking DQM the plot of the tracking efficiency VS dR, where dR is the distance between a track and the caloJets axis. This is a relevant parameter in the core of the jets, where the efficiency drops. Only tracks with dR lower than 0.1 in jets of Pt above 1 TeV are included in the calculation of the efficiency by default.
@arizzi

@cmsbuild
Copy link
Contributor

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-25514/7694

  • Found files with invalid states:
    • Validation/RecoTrack/test/MultiTrackValidator_cfg_MOD.py: Added, Deleted

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @vberta for master.

It involves the following packages:

Validation/RecoTrack

@kmaeshima, @cmsbuild, @andrius-k, @jfernan2, @schneiml can you please review it and eventually sign? Thanks.
@makortel, @felicepantaleo, @GiacomoSguazzoni, @rovere, @VinInn, @wmtford, @ebrondol, @mtosi, @dgulhan this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@mtosi
Copy link
Contributor

mtosi commented Dec 18, 2018

thanks !
my comment is that this is Validation, and not DQM
=> this code will be run only on MC
there will be an other PR for the DQM, I guess

then, I see there are spurious extra spaces, etc

@mtosi
Copy link
Contributor

mtosi commented Dec 18, 2018

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 18, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/32255/console Started: 2018/12/18 17:39

@cmsbuild
Copy link
Contributor

-1

Tested at: e699027

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25514/32255/summary.html

I found follow errors while testing this PR

Failed tests: Build ClangBuild

  • Build:

I found compilation warning when building: See details on the summary page.

  • Clang:

I found compilation warning while trying to compile with clang. Command used:

USER_CUDA_FLAGS='--expt-relaxed-constexpr' USER_CXXFLAGS='-Wno-register -fsyntax-only' scram build -k -j 16 COMPILER='llvm compile'

See details on the summary page.

@cmsbuild
Copy link
Contributor

Comparison not run due to Build errors (RelVals and Igprof tests were also skipped)

Copy link
Contributor

@makortel makortel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new plots (thanks!) should be made optional because MTV is used workflows that do not run any calo reco.

Please consider also adding the corresponding fake rate, duplicate rate, and pileup rate plots (mainly for consistency).

@@ -26,6 +26,7 @@

#include "DQMServices/Core/interface/ConcurrentMonitorElement.h"
#include "DQMServices/Core/interface/DQMStore.h"
#include "DataFormats/Candidate/interface/Candidate.h"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No need for this include here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, removed

@@ -159,6 +160,7 @@ class MTVHistoProducerAlgoForTracker {
const reco::Track* track,
int numVertices,
double dR,
double dR_jet,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please keep indentation consistent.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok indented

@@ -776,6 +823,7 @@ void MultiTrackValidator::dqmAnalyze(const edm::Event& event, const edm::EventSe
double dxyPVSim = 0;
double dzPVSim = 0;
double dR=dR_tPCeff[iTP];
double dR_jet=dR_tPCeff_jet[iTP];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Indentation is off.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok indented

@@ -882,6 +890,7 @@ void MTVHistoProducerAlgoForTracker::fill_recoAssociated_simTrack_histos(const H
const reco::Track* track,
int numVertices,
double dR,
double dRJet,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Indentation is off.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok indented

@@ -98,6 +98,9 @@

### do resolution plots only for these labels (or all if empty)
doResolutionPlotsForLabels = cms.VInputTag(),

cores = cms.InputTag("ak4CaloJets"),
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not ak4CaloJetsForTrk?

float eta = etaL[iTP1];
float phi = phiL[iTP1];
for (unsigned int ji = 0; ji < cores->size(); ji++) {//jet loop
if((*cores)[ji].pt() > ptMinJet_){
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd prefer that this cut would be made with a (generic ref) selector outside MTV.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@makortel I guess in the log term we could also think of binning rather than cutting on Jet pT, so I'd rather keep the cut inside. What would be the advantage of an additional external selection?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@arizzi I was mainly thinking to avoid extending the MTV complexity when something could be done outside of it. Also currently all other cuts than the "standard" TrackingParticle efficiency denominator cuts are done outside MTV. A generic jet selector outside MTV would also provide an easy placeholder for any other cuts on jets (eta, phi, who knows). Binning cuts are certainly necessary to do here, I agree.

At minimum the minimal cuts on jets (now minimum pT) should be done only once, i.e. moved outside of the loop over selected_tPCeff.

@makortel
Copy link
Contributor

I was a bit too fast. Some of my comments on the code conflict with

The new plots should be made optional because MTV is used workflows that do not run any calo reco.

because then the View<Candidate> is likely easiest to pass around as a pointer (that can be nullptr).

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25514/33214/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-25514/10824.1_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_trackingOnly_2018+HARVESTFull_trackingOnly_2018
  • /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-25514/10824.5_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_pixelTrackingOnly_2018+HARVESTFull_pixelTrackingOnly_2018

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 32
  • DQMHistoTests: Total histograms compared: 3098286
  • DQMHistoTests: Total failures: 2197
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3095892
  • DQMHistoTests: Total skipped: 197
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 3606.925 KiB( 31 files compared)
  • DQMHistoSizes: changed ( 20034.0,... ): 86.836 KiB Tracking/Track
  • DQMHistoSizes: changed ( 20034.0,... ): 26.060 KiB Tracking/TrackTPPtLess09
  • DQMHistoSizes: changed ( 20034.0,... ): 16.062 KiB Tracking/TrackBuilding
  • DQMHistoSizes: changed ( 20034.0,... ): 8.461 KiB Tracking/TrackFromPV
  • DQMHistoSizes: changed ( 20034.0,... ): 8.207 KiB Tracking/TrackConversion
  • DQMHistoSizes: changed ( 20034.0,... ): 5.904 KiB Tracking/TrackFromPVAllTP
  • DQMHistoSizes: changed ( 20034.0,... ): 4.152 KiB Tracking/TrackAllTPEffic
  • DQMHistoSizes: changed ( 20034.0,... ): 1.925 KiB Tracking/TrackGsf
  • DQMHistoSizes: changed ( 10042.0,... ): 130.879 KiB Tracking/Track
  • DQMHistoSizes: changed ( 10042.0,... ): 40.634 KiB Tracking/TrackTPPtLess09
  • DQMHistoSizes: changed ( 10042.0 ): ...
  • Checked 133 log files, 14 edm output root files, 32 DQM output files

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25514/33214/summary.html

The workflows 1001.0, 1000.0, 1325.7, 140.56, 140.53, 136.85, 136.8311, 136.788, 136.7611, 136.731, 4.53, 4.22 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-25514/10824.1_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_trackingOnly_2018+HARVESTFull_trackingOnly_2018
  • /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-25514/10824.5_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_pixelTrackingOnly_2018+HARVESTFull_pixelTrackingOnly_2018

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 32
  • DQMHistoTests: Total histograms compared: 0
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 0
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0 KiB( 0 files compared)
  • Checked 0 log files, 0 edm output root files, 32 DQM output files

@andrius-k
Copy link

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@fabiocos
Copy link
Contributor

please test workflow 10824.1,10824.5

to get a clean final output

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 27, 2019

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/33320/console Started: 2019/02/27 15:18

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25514/33320/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-25514/10824.1_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_trackingOnly_2018+HARVESTFull_trackingOnly_2018
  • /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-25514/10824.5_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_pixelTrackingOnly_2018+HARVESTFull_pixelTrackingOnly_2018

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 2 differences found in the comparisons
  • DQMHistoTests: Total files compared: 32
  • DQMHistoTests: Total histograms compared: 3098286
  • DQMHistoTests: Total failures: 2197
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3095892
  • DQMHistoTests: Total skipped: 197
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 3606.925 KiB( 31 files compared)
  • DQMHistoSizes: changed ( 25202.0,... ): 104.461 KiB Tracking/Track
  • DQMHistoSizes: changed ( 25202.0,... ): 31.892 KiB Tracking/TrackTPPtLess09
  • DQMHistoSizes: changed ( 25202.0,... ): 22.306 KiB Tracking/TrackBuilding
  • DQMHistoSizes: changed ( 25202.0,... ): 14.860 KiB HLT/Tracking
  • DQMHistoSizes: changed ( 25202.0,... ): 9.096 KiB HLT/Muon
  • DQMHistoSizes: changed ( 25202.0,... ): 8.461 KiB Tracking/TrackFromPV
  • DQMHistoSizes: changed ( 25202.0,... ): 8.207 KiB Tracking/TrackConversion
  • DQMHistoSizes: changed ( 25202.0,... ): 5.904 KiB Tracking/TrackFromPVAllTP
  • DQMHistoSizes: changed ( 25202.0,... ): 4.152 KiB Tracking/TrackAllTPEffic
  • DQMHistoSizes: changed ( 25202.0,... ): 2.062 KiB HLT/EGM
  • DQMHistoSizes: changed ( 25202.0 ): ...
  • Checked 133 log files, 14 edm output root files, 32 DQM output files

@fabiocos
Copy link
Contributor

+1

@makortel I understand you are satisfied by the current status of this PR

@cmsbuild cmsbuild merged commit d5afd9d into cms-sw:master Feb 28, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants