Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TkAl: making mille job submission via condor possible #25437

Merged
merged 2 commits into from Dec 11, 2018

Conversation

adewit
Copy link
Contributor

@adewit adewit commented Dec 6, 2018

This adds the functionality to submit all parts of the MillePede alignment algorithm to condor (in preparation of LSF-CAF decommissioning). For now LSF submission is still the default, but condor submission is fully supported.
Note that the submission could be made more efficient, as at the moment now we submit one job per cluster - submitting multiple jobs per cluster requires some overhaul of the current workflow. I have some ideas but this will take a bit more time to get right, and so will follow later.

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 6, 2018

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 6, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 6, 2018

A new Pull Request was created by @adewit for master.

It involves the following packages:

Alignment/MillePedeAlignmentAlgorithm

@cmsbuild, @franzoni, @pohsun, @tocheng, @lpernie can you please review it and eventually sign? Thanks.
@mschrode, @mmusich, @tocheng, @tlampen this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@pohsun
Copy link

pohsun commented Dec 10, 2018

@adewit Do you manage to implement the improvement in the note soon?
Maybe we could merge the improvement to this PR.

@adewit
Copy link
Contributor Author

adewit commented Dec 10, 2018

@pohsun No, I don't think I'll be able to do it soon (that's why I already made the PR). If there are objections to merging this now we can wait, but it certainly won't come this year anymore.

@pohsun
Copy link

pohsun commented Dec 10, 2018

+1
@adewit Thank you for the clarification.

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 10, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/32093/console Started: 2018/12/10 14:35

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs after it passes the integration tests. This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25437/32093/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 33
  • DQMHistoTests: Total histograms compared: 3136422
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3136217
  • DQMHistoTests: Total skipped: 204
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 32 files compared)
  • Checked 137 log files, 14 edm output root files, 33 DQM output files

@fabiocos
Copy link
Contributor

@adewit this is not breaking anything in the release as far as I can see, but was it tested?

@adewit
Copy link
Contributor Author

adewit commented Dec 11, 2018

@fabiocos Yes, it was tested and has the expected behaviour.

@fabiocos
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 3fb0647 into cms-sw:master Dec 11, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants