Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to CLHEP 2.4.0.0 #3616

Merged
merged 1 commit into from Dec 21, 2017

Conversation

civanch
Copy link
Contributor

@civanch civanch commented Dec 6, 2017

Main modification - improved MixMax random number generator and make it default. The test should show no difference with the baseline, because in CMSSW explicit random number generators are defined per producer, so the old ones will be used.

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 6, 2017

A new Pull Request was created by @civanch (Vladimir Ivantchenko) for branch IB/CMSSW_10_0_X/gcc630.

@cmsbuild, @smuzaffar, @gudrutis, @mrodozov can you please review it and eventually sign? Thanks.
You can sign-off by replying to this message having '+1' in the first line of your reply.
You can reject by replying to this message having '-1' in the first line of your reply.

@civanch
Copy link
Contributor Author

civanch commented Dec 6, 2017

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 6, 2017

The tests are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 6, 2017

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 6, 2017

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 6, 2017

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3616/24973/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /build/cmsbld/jenkins-workarea/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-3616/1325.7_TTbar_13_94XNanoAODINPUT+TTbar_13_94XNanoAODINPUT+NANOEDMMC2017

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 2 differences found in the comparisons
  • DQMHistoTests: Total files compared: 27
  • DQMHistoTests: Total histograms compared: 2835085
  • DQMHistoTests: Total failures: 6735
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2828172
  • DQMHistoTests: Total skipped: 178
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.729999999974 KiB( 23 files compared)
  • Checked 113 log files, 9 edm output root files, 27 DQM output files

@civanch
Copy link
Contributor Author

civanch commented Dec 6, 2017

It is strange, that the difference is two WFs only: 5.1 and 135.4

@civanch
Copy link
Contributor Author

civanch commented Dec 7, 2017

For WF 5.1 one of the plots:
jetmet__jetvalidation_ak4pfjetschs_photonmultiplicity
It is clear that random numbers are different

@smuzaffar
Copy link
Contributor

@davidlange6 , any objection getting this one in?

@davidlange6
Copy link
Contributor

hi @civanch - but we don't expect different random number sequences unless there is a change. Lets check that its reproducible - otherwise is there something in the release notes that suggests a bug fix that might affect fast sim?

@davidlange6
Copy link
Contributor

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 9, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/25024/console

@civanch
Copy link
Contributor Author

civanch commented Dec 9, 2017

@smuzaffar , @davidlange6 the difference in two FWs means that there are places were where CMS Service for random numbers do not used, instead CLHEP random engine is called directly. CLHEP random default was changed but this does not affect CMS RandomService which is explicit per producer. The suspect is also generators, in these WFs they likely from run-1.

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 9, 2017

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 9, 2017

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 9, 2017

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3616/25024/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /build/cmsbld/jenkins-workarea/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-3616/1325.7_TTbar_13_94XNanoAODINPUT+TTbar_13_94XNanoAODINPUT+NANOEDMMC2017

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 2 differences found in the comparisons
  • DQMHistoTests: Total files compared: 27
  • DQMHistoTests: Total histograms compared: 2835241
  • DQMHistoTests: Total failures: 6721
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2828342
  • DQMHistoTests: Total skipped: 178
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.679999999906 KiB( 23 files compared)
  • Checked 113 log files, 9 edm output root files, 27 DQM output files

@davidlange6
Copy link
Contributor

hi @civanch - it can not be gen - as the generators are the same here and in full sim. (both run1/run2)

i notice that the HepRandom defaults have changed to mixmax - do we just discover that someone is using the default (that probably shouldn't be)

@civanch
Copy link
Contributor Author

civanch commented Dec 12, 2017

Hi, @davidlange6 , I agree with you, that it is the FastSim feature - we discover that somewhere in FastSim the default CLHEP generator is used. Also FastSim is tightly coupled with TRandom3 - I see inside FastSim even checks this... We need discuss this with FastSim experts but this should not stop from merge of this CLHEP PR - when FatsSim will be fully understood likely a CMSSW PR will be needed but should we wait for that?

@civanch
Copy link
Contributor Author

civanch commented Dec 12, 2017

@ssekmen - we see a problem in FastSim WFs.

@davidlange6
Copy link
Contributor

davidlange6 commented Dec 12, 2017 via email

@civanch
Copy link
Contributor Author

civanch commented Dec 12, 2017

The sequence is long. I grep all places in FastSim without full understanding of the situation.

@davidlange6
Copy link
Contributor

davidlange6 commented Dec 12, 2017 via email

@civanch
Copy link
Contributor Author

civanch commented Dec 12, 2017

there may search for G4UniformRand() it is only one idea.

@davidlange6
Copy link
Contributor

davidlange6 commented Dec 12, 2017 via email

@ssekmen
Copy link

ssekmen commented Dec 12, 2017

@civanch , checking. This could be happening in the calorimetry code.

@ssekmen
Copy link

ssekmen commented Dec 12, 2017

G4UniformRand seems to be used in fastsim HF showers: FastSimulation/ShowerDevelopment/src/FastHFShowerLibrary.cc .

@civanch
Copy link
Contributor Author

civanch commented Dec 12, 2017

Also FastSimulation/CTPPSRecHitProducer in several places use directly CLHEP for Gauss.

@davidlange6
Copy link
Contributor

davidlange6 commented Dec 12, 2017 via email

@smuzaffar smuzaffar merged commit c75c02f into cms-sw:IB/CMSSW_10_0_X/gcc630 Dec 21, 2017
@cms-sw cms-sw deleted a comment from cmsbuild Dec 21, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants