Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Raw data remapper #24819

Merged
merged 19 commits into from Oct 16, 2018
Merged

Raw data remapper #24819

merged 19 commits into from Oct 16, 2018

Conversation

icali
Copy link
Contributor

@icali icali commented Oct 7, 2018

First implementation of the ReMapper.
It should contains all the features as discussed in the #24619 (comment)

Please comment of what you think is missing or how it should be modified. Also the naming of the module could be adjusted.

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2018

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2018

A new Pull Request was created by @icali (Ivan Amos Cali) for master.

It involves the following packages:

EventFilter/RawDataCollector

@mommsen, @cmsbuild, @emeschi can you please review it and eventually sign? Thanks.
@Martin-Grunewald this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@slava77
Copy link
Contributor

slava77 commented Oct 7, 2018

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/30913/console Started: 2018/10/07 18:21

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2018

-1

Tested at: 0707979

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24819/30913/summary.html

I found follow errors while testing this PR

Failed tests: Build ClangBuild

  • Build:

I found an error when building:

>> Compiling edm plugin /build/cmsbld/jenkins/workspace/ib-any-integration/CMSSW_10_3_X_2018-10-06-1100/src/EventFilter/RawDataCollector/src/RawDataFEDSelector.cc 
>> Compiling edm plugin /build/cmsbld/jenkins/workspace/ib-any-integration/CMSSW_10_3_X_2018-10-06-1100/src/EventFilter/RawDataCollector/src/RawDataCollectorByLabel.cc 
>> Compiling edm plugin /build/cmsbld/jenkins/workspace/ib-any-integration/CMSSW_10_3_X_2018-10-06-1100/src/EventFilter/RawDataCollector/src/RawDataMapperByLabel.cc 
>> Compiling edm plugin /build/cmsbld/jenkins/workspace/ib-any-integration/CMSSW_10_3_X_2018-10-06-1100/src/EventFilter/RawDataCollector/src/SealModule.cc 
/build/cmsbld/jenkins/workspace/ib-any-integration/CMSSW_10_3_X_2018-10-06-1100/src/EventFilter/RawDataCollector/src/RawDataMapperByLabel.cc: In constructor 'RawDataMapperByLabel::RawDataMapperByLabel(const edm::ParameterSet&)':
/build/cmsbld/jenkins/workspace/ib-any-integration/CMSSW_10_3_X_2018-10-06-1100/src/EventFilter/RawDataCollector/src/RawDataMapperByLabel.cc:27:3: error: 'verbose_' was not declared in this scope
   verbose_ = pset.getUntrackedParameter("verbose",0);
   ^~~~~~~~
gmake: *** [tmp/slc6_amd64_gcc700/src/EventFilter/RawDataCollector/src/EventFilterRawDataCollector/RawDataMapperByLabel.cc.o] Error 1
>> Building edm plugin tmp/slc6_amd64_gcc700/src/EventFilter/RawDataCollector/src/EventFilterRawDataCollector/libEventFilterRawDataCollector.so
c++: error: tmp/slc6_amd64_gcc700/src/EventFilter/RawDataCollector/src/EventFilterRawDataCollector/RawDataMapperByLabel.cc.o: No such file or directory

  • Clang:

I found a compilation error while trying to compile with clang:
I used this command:
scram b vclean && USER_CUDA_FLAGS='--expt-relaxed-constexpr' USER_CXXFLAGS='-Wno-register -fsyntax-only' scram build -k -j 48 COMPILER='llvm compile' BUILD_LOG=yes && scram build outputlog && (/build/cmsbld/jenkins/workspace/ib-any-integration/cms-bot/buildLogAnalyzer.py --logDir /build/cmsbld/jenkins/workspace/ib-any-integration/CMSSW_10_3_X_2018-10-06-1100/tmp/slc6_amd64_gcc700/cache/log/src || true)

>> Local Products Rules ..... started
>> Local Products Rules ..... done
>> Creating project symlinks
>> Entering Package EventFilter/RawDataCollector
>> Compile sequence completed for CMSSW CMSSW_10_3_X_2018-10-06-1100
gmake: *** [There are compilation/build errors. Please see the detail log above.] Error 1


@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2018

Comparison not run due to Build errors (RelVals and Igprof tests were also skipped)

@cmsbuild
Copy link
Contributor

Pull request #24819 was updated. @mommsen, @cmsbuild, @emeschi can you please check and sign again.

@slava77
Copy link
Contributor

slava77 commented Oct 14, 2018

@cmsbuild please test

@icali
were you able to resolve the run time issues (mentioned/related to #24819 (comment))?

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 14, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/31021/console Started: 2018/10/14 10:29

@icali
Copy link
Contributor Author

icali commented Oct 14, 2018 via email

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24819/31021/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 32
  • DQMHistoTests: Total histograms compared: 2994723
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2994525
  • DQMHistoTests: Total skipped: 197
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
  • Checked 134 log files, 14 edm output root files, 32 DQM output files

@mommsen
Copy link
Contributor

mommsen commented Oct 15, 2018

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@fabiocos
Copy link
Contributor

@icali @slava77 sorry, I am a bit confused by #24819 (comment) : the module is technically compiling, and aesthetically clean, but in practice it hangs if used in a real workflow? Or am I misinterpreting the comment?

@fabiocos fabiocos mentioned this pull request Oct 15, 2018
8 tasks
@icali icali mentioned this pull request Oct 16, 2018
@fabiocos
Copy link
Contributor

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants