Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve the procedure to install the CUDA tools in CMSSW #4099

Conversation

fwyzard
Copy link
Contributor

@fwyzard fwyzard commented Jun 8, 2018

Leave out nvidia nsight (IDE) and nvvp (visual profiler) from the CUDA distribution.

These tools are only useful on the developer's machine, not on the worker nodes, and we expect the developers to run them on their local desktops/notebooks rather than on lxplus.
Leaving them out saves almost 500 MB from the archive and installation.

Handle the case where $CUDA_BASE/include is a symlink

This is needed for the AMR64 packaging of CUDA.

Add a wrapper for cuda-gdb and package its support files

Set PYTHONHOME to scram's $PYTHON_BASE to fix the error:

Could not find platform independent libraries
Could not find platform dependent libraries <exec_prefix>
Consider setting $PYTHONHOME to [:<exec_prefix>]
ImportError: No module named site

Package $CUDA_BASE/share/gdb to fix the error:

Python Exception <type 'exceptions.NameError'> Installation error: gdb.execute_unwinders function is missing:

@fwyzard
Copy link
Contributor Author

fwyzard commented Jun 8, 2018

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 8, 2018

The tests are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 8, 2018

A new Pull Request was created by @fwyzard (Andrea Bocci) for branch IB/CMSSW_10_2_X/gcc630.

@cmsbuild, @smuzaffar, @gudrutis, @mrodozov can you please review it and eventually sign? Thanks.
You can sign-off by replying to this message having '+1' in the first line of your reply.
You can reject by replying to this message having '-1' in the first line of your reply.

@fwyzard fwyzard force-pushed the IB/CMSSW_10_2_X/gcc630_cuda_no_nsight branch from e0d7139 to ac623fc Compare June 8, 2018 11:51
@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 8, 2018

Pull request #4099 was updated.

@fwyzard
Copy link
Contributor Author

fwyzard commented Jun 8, 2018

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 8, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/28562/console

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 8, 2018

Pull request #4099 was updated.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 8, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 8, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 8, 2018

Pull request has been put on hold by @fwyzard
They need to issue an unhold command to remove the hold state or L1 can unhold it for all

@cmsbuild cmsbuild added the hold label Jun 8, 2018
@fwyzard fwyzard force-pushed the IB/CMSSW_10_2_X/gcc630_cuda_no_nsight branch from ba18aa1 to b0d1f7a Compare June 8, 2018 15:35
@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 8, 2018

Pull request #4099 was updated.

@fwyzard fwyzard changed the title Leave out nsight and nvvp from the CUDA distribution Improve the procedure to install the CUDA tools in CMSSW Jun 8, 2018
@fwyzard
Copy link
Contributor Author

fwyzard commented Jun 8, 2018

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 8, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/28589/console

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 9, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 9, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 9, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-4099/28589/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 31
  • DQMHistoTests: Total histograms compared: 2902751
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2902560
  • DQMHistoTests: Total skipped: 190
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 30 files compared)
  • Checked 128 log files, 14 edm output root files, 31 DQM output files

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 9, 2018

Pull request #4099 was updated.

@fwyzard
Copy link
Contributor Author

fwyzard commented Jun 9, 2018

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 9, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/28598/console

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 9, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 9, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 9, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-4099/28598/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 31
  • DQMHistoTests: Total histograms compared: 2902751
  • DQMHistoTests: Total failures: 2
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2902559
  • DQMHistoTests: Total skipped: 190
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 30 files compared)
  • Checked 128 log files, 14 edm output root files, 31 DQM output files

@smuzaffar
Copy link
Contributor

+externals

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_10_2_X/gcc630 IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@fwyzard fwyzard deleted the IB/CMSSW_10_2_X/gcc630_cuda_no_nsight branch August 28, 2018 16:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants