Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simple configuration testing #20466

Merged
merged 3 commits into from Sep 12, 2017
Merged

Conversation

Dr15Jones
Copy link
Contributor

Items to be used to test configurations made up of 'trivial' modules.
This includes a new script edmTracerLogToSimpleConfig.py which can read a job log which
containers Tracer output and then create a new configuration with the same module topology
but with the modules replaced with 'trivial' instances.
This allows for finding performance bottlenecks in the framework for standard configurations topologies.

AddIntsProducer is being used in timing tests so better to use more performant getBy call.
Added an Analyzer that gets IntProducts. This is used in infrastructure timing tests.
The script can read the log file of a job that used the Tracer with 'dumpPathsAndConsumes' turned on.
From that log file it can create a new configuration file which has the same module topology but with
the modules all replaced with 'trivial' counterparts.
@cmsbuild
Copy link
Contributor

The code-checks are being triggered in jenkins.

@Dr15Jones
Copy link
Contributor Author

please test

@Dr15Jones
Copy link
Contributor Author

+1

@Dr15Jones
Copy link
Contributor Author

@fwyzard you can use this to test the maximum throughput for the HLT topology.

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/PR-20466/636

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 11, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/22875/console Started: 2017/09/11 21:07

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @Dr15Jones (Chris Jones) for master.

It involves the following packages:

FWCore/Framework
FWCore/Services

@cmsbuild can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @wddgit this is something you requested to watch as well.
@davidlange6, @slava77 you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20466/22875/summary.html

There are some workflows for which there are errors in the baseline:
1330.0 step 4
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 26
  • DQMHistoTests: Total histograms compared: 2563849
  • DQMHistoTests: Total failures: 217
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2563446
  • DQMHistoTests: Total skipped: 186
  • DQMHistoTests: Total Missing objects: 0
  • Checked 107 log files, 14 edm output root files, 26 DQM output files

@davidlange6
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 17b748f into cms-sw:master Sep 12, 2017
@Dr15Jones Dr15Jones deleted the simpleConfigTester branch September 12, 2017 13:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants