Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(DAQ) Revert to untracked parameters and new configuration #28359

Merged
merged 4 commits into from
Nov 18, 2019

Conversation

smorovic
Copy link
Contributor

@smorovic smorovic commented Nov 7, 2019

PR description:

Reverting to untracked parameters in EvFDaqDirector as discussed in #28151
Including also these changes:

  • new parameter is added to control if fileBrokeHost parameter can be changed within the process by looking at hltd configuration (which is current behavior).
  • default value is removed from fileBrokerHost, so it must always be present for the configuration to run successfully.
  • other parameters in the service have also been regrouped, and one was renamed.

PR validation:

Tested in DAQ "VM" test cluster with several relevant combinations of parameters. RunBUFU.sh in EventFilter/Utilities/test also runs fine.

…sn't

  have any defaults, so it must be present in the configuration in all
  cases.
- add option to enable reading fileBrokerHost from local configuration
  file (default). Disabling it allows specifying it as parameter.
  Python snippet will have to enable it to set file broker host
- Reordering, renaming some parameters: consistent naming and grouping
  per function. Nonexisting parameters are no longer allowed.
@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28359/12658

  • This PR adds an extra 36KB to repository

Code check has found code style and quality issues which could be resolved by applying following patch(s)

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28359/12659

  • This PR adds an extra 36KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

A new Pull Request was created by @smorovic (Srecko Morovic) for master.

It involves the following packages:

EventFilter/Utilities

@perrotta, @mommsen, @cmsbuild, @emeschi, @slava77 can you please review it and eventually sign? Thanks.
@Martin-Grunewald this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@Martin-Grunewald
Copy link
Contributor

@smorovic
On this issue:

default value is removed from fileBrokerHost, so it must always be present for the configuration to run successfully.

please do NOT do this: parameters without a default will not be written to the fillDescriptions generated cfi file (as the code does not know which value to put).
In turn, ConfDB parsing the cfi file will never know about this parameter.
So you will never be able to set it to any value in ConfDB!
Please revert and give a value, even is it is a value of "InValid" or so, and you check the string being "InValid" and issue an error message then!

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

The code-checks are being triggered in jenkins.

@smorovic
Copy link
Contributor Author

smorovic commented Nov 7, 2019

Well, maybe "addUntracked" (or even "add") function without default should then be removed, unless there is use case I don't see.

It has now been changed to InValid as default.

@Martin-Grunewald
Copy link
Contributor

Martin-Grunewald commented Nov 7, 2019

Thanks.
People not using ConfDB GUI are able to use the feature, but ConfDB uses cfi files to discover the parameters, so for that use case all parameters must appear in the fillDescriptions generated cfi file.

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28359/12660

  • This PR adds an extra 36KB to repository

Code check has found code style and quality issues which could be resolved by applying following patch(s)

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28359/12661

  • This PR adds an extra 36KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

Pull request #28359 was updated. @perrotta, @mommsen, @cmsbuild, @emeschi, @slava77 can you please check and sign again.

@perrotta
Copy link
Contributor

perrotta commented Nov 7, 2019

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/3385/console Started: 2019/11/07 22:45

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 8, 2019

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-4e2038/3385/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2936360
  • DQMHistoTests: Total failures: 11
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2936008
  • DQMHistoTests: Total skipped: 341
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

@slava77
Copy link
Contributor

slava77 commented Nov 8, 2019

+1

for #28359 1749535

  • reco code is not affected

@fabiocos
Copy link
Contributor

@mommsen comments?

@mommsen
Copy link
Contributor

mommsen commented Nov 17, 2019

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@fabiocos
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 1021afb into cms-sw:master Nov 18, 2019
@smorovic smorovic deleted the 11X-untracked-parameters-no-defaults branch November 19, 2019 13:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants