Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed checksum upload validation when compressing LHE files #11088

Merged

Conversation

davidsheffield
Copy link
Contributor

Backport of #9396.

Script only gets the checksum of the files being added to EOS.
When compressing LHE files with the previous behavior, the script added a checksum for both the original .lhe file and the compressed .lhe.xz. Therefore, it would not compare the correct checksum to the file in EOS and and always produce a warning if the compression option was used.

Previously it checked:
eos/file1.lhe.xz <-> local/file1.lhe
eos/file2.lhe.xz <-> local/file1.lhe.xz
eos/file3.lhe.xz <-> local/file2.lhe
eos/file4.lhe.xz <-> local/file2.lhe.xz
etc.

Now it checks
eos/file1.lhe.xz <-> local/file1.lhe.xz
eos/file2.lhe.xz <-> local/file2.lhe.xz
eos/file3.lhe.xz <-> local/file3.lhe.xz
eos/file4.lhe.xz <-> local/file4.lhe.xz
etc.

Script only gets the checksum of the files being added to EOS.
When compressing LHE files with the previous behavior, the script added a checksum for both the original .lhe file and the compressed .lhe.xz. Therefore, it would not compare the correct checksum to the file in EOS and and always produce a warning if the compression option was used.
@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2015

A new Pull Request was created by @davidsheffield (David Sheffield) for CMSSW_7_1_X.

Fixed checksum upload validation when compressing LHE files

It involves the following packages:

GeneratorInterface/LHEInterface

@vciulli, @covarell, @thuer, @cmsbuild, @bendavid, @govoni can you please review it and eventually sign? Thanks.
@mkirsano this is something you requested to watch as well.
You can sign-off by replying to this message having '+1' in the first line of your reply.
You can reject by replying to this message having '-1' in the first line of your reply.
If you are a L2 or a release manager you can ask for tests by saying 'please test' in the first line of a comment.
@Degano you are the release manager for this.
You can merge this pull request by typing 'merge' in the first line of your comment.

@OlivierBondu
Copy link
Contributor

Except I would suggest a bump in version number (1.13 -> 1.14), the new script works fine for me (tested on eos article 15447)

could this be merged ?

It is a quite useful check for every single new pLHE request that goes into MCM...

@covarell
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/9953/console

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next CMSSW_7_1_X IBs after it passes the integration tests. This pull request requires discussion in the ORP meeting before it's merged. @slava77, @davidlange6, @Degano, @smuzaffar

@davidsheffield
Copy link
Contributor Author

I'll add a pull request for 8_0_X now that it's the working release. Should I update the version number in 8_0_X if it isn't updated here?

@covarell
Copy link
Contributor

It is ok to leave the old one, I don't know who introduced this numbering but it is much better to keep track of changes via git commits

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-11088/9953/summary.html

@slava77 there are some missing matrix maps:

  • 1306.0_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15
  • 25202.0_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVEST+MINIAODMC
  • 50202.0_TTbar_13+TTbar_13+DIGIUP15_PU50+RECOUP15_PU50+HARVEST+MINIAODMC50

@davidlange6
Copy link
Contributor

+1

cmsbuild added a commit that referenced this pull request Dec 3, 2015
Fixed checksum upload validation when compressing LHE files
@cmsbuild cmsbuild merged commit 0c54573 into cms-sw:CMSSW_7_1_X Dec 3, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants