Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include the CUDA Profiling Tools Interface (CUPTI) #5512

Merged
merged 2 commits into from Feb 1, 2020

Conversation

fwyzard
Copy link
Contributor

@fwyzard fwyzard commented Jan 30, 2020

No description provided.

@fwyzard
Copy link
Contributor Author

fwyzard commented Jan 30, 2020

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 30, 2020

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/4439/console Started: 2020/01/30 20:24

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @fwyzard (Andrea Bocci) for branch IB/CMSSW_11_1_X/master.

@cmsbuild, @smuzaffar, @mrodozov, @tulamor can you please review it and eventually sign? Thanks.
cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

+1
Tested at: c3ee107
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-d86128/4439/summary.html
CMSSW: CMSSW_11_1_X_2020-01-30-1100
SCRAM_ARCH: slc7_amd64_gcc820

@cmsbuild
Copy link
Contributor

Comparison job queued.

@fwyzard
Copy link
Contributor Author

fwyzard commented Jan 30, 2020

@smuzaffar could you include this in the next IBs ?

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-d86128/4439/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2697068
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2696721
  • DQMHistoTests: Total skipped: 346
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

<info url="https://docs.nvidia.com/cupti/Cupti/index.html"/>
<lib name="nvperf_host"/>
<lib name="nvperf_target"/>
</tool>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fwyzard do we need these new tools? A tool with out INCLUDE and LIBDIR directory is of no use. If someone adds a dependency in BuildFile then scram does not know what should be -L/path for these libs.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the include and libdir should be the same as cuda; should I add them explicitly ?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

did you check if these libs are linked against libcuda.so? if then then just add dependency on cuda otherwise I would suggest to add a new cuda_interface tool file e.g. something like [a] and depend on it

[a]

cat << \EOF_TOOLFILE >%{i}/etc/scram.d/cuda_intrface.xml
<tool name="cuda_interface" version="@TOOL_VERSION@">
  <info url="https://docs.nvidia.com/cuda/index.html"/>
  <client>
    <environment name="CUDA_INTERFACE_BASE" default="@TOOL_ROOT@"/>
    <environment name="LIBDIR"          default="$CUDA_INTERFACE_BASE/lib64/stubs"/>
    <environment name="INCLUDE"         default="$CUDA_INTERFACE_BASE/include"/>
  </client>
  <flags SKIP_TOOL_SYMLINKS="1"/>
</tool>
EOF_TOOLFILE

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, according to the output of ldd the new libraries do not depend on other cuda libraries.

For the moment I'll just add the include and lib64 explicitly, we can revise it once we understand a bit better the dependencies.

@cmsbuild
Copy link
Contributor

Pull request #5512 was updated.

@fwyzard
Copy link
Contributor Author

fwyzard commented Jan 31, 2020

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 31, 2020

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/4443/console Started: 2020/01/31 11:37

@cmsbuild
Copy link
Contributor

+1
Tested at: 15e4173
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-d86128/4443/summary.html
CMSSW: CMSSW_11_1_X_2020-01-30-2300
SCRAM_ARCH: slc7_amd64_gcc820

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-d86128/4443/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2697068
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2696721
  • DQMHistoTests: Total skipped: 346
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

@fwyzard
Copy link
Contributor Author

fwyzard commented Jan 31, 2020

@smuzaffar can you merge this ?
I would like to include the fix in the next Patatrack release

@smuzaffar
Copy link
Contributor

+externals

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_11_1_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @silviodonato, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@fwyzard
Copy link
Contributor Author

fwyzard commented Feb 1, 2020

@silviodonato could you approve this for the coming IBs ?

@smuzaffar
Copy link
Contributor

merging it as this looks good and it just adds new tools, so should not break any thing.

@smuzaffar smuzaffar merged commit dae3ce5 into cms-sw:IB/CMSSW_11_1_X/master Feb 1, 2020
@fwyzard fwyzard deleted the cuda_10.2 branch April 16, 2020 13:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants