New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Prevent too many chunks from being added per function call. #10021
Conversation
We have a limit of 1,024 chunks per IO vector and stop adding new chunks once we hit 1,000. However, the consumeChunk* calls previously were able to add an unlimited number of new chunks - meaning that we could go past the limit in a single loop iteration.
A new Pull Request was created by @bbockelm (Brian Bockelman) for CMSSW_7_4_X. Prevent too many chunks from being added per function call. It involves the following packages: Utilities/XrdAdaptor @cmsbuild, @smuzaffar, @Dr15Jones can you please review it and eventually sign? Thanks. |
please test |
Please also make versions for 7_5 and 7_6. |
The tests are being triggered in jenkins. |
@cmsbuild @Dr15Jones - what happened to the jenkins tests? I was planning on cherry picking to 7_5 / 7_6 once the tests passed. |
@smuzaffar Were the tests stuck? |
@smuzaffar any updates on the jenkins tests for this one? |
please test |
@smuzaffar - are we just unlucky for this PR? |
@cmsbuild please test should be better now
|
I thought that adding "please test" will trigger the tests but looks On 07/09/2015 07:36 AM, David Lange wrote:
|
@davidlange6 , do we want to add in 74X without testit in 75X/76X? |
+1 |
@davidlange6 How do you want to proceed with actual large scale test of this? Shahzad asked if this really should be in 7_5 or 7_6 first. Or did I miss a related pull request? |
This pull request is fully signed and it will be integrated in one of the next CMSSW_7_4_X IBs once checked with relvals in the development release cycle of CMSSW (tests are also fine). This pull request requires discussion in the ORP meeting before it's merged. @davidlange6, @Degano, @smuzaffar |
@davidlange6 - What's the strategy on this one? |
@bbockelm -good point - is not there not a 75x or 76x version of this? |
+1 |
Prevent too many chunks from being added per function call.
We have a limit of 1,024 chunks per IO vector and stop adding new
chunks once we hit 1,000. However, the consumeChunk* calls previously
were able to add an unlimited number of new chunks - meaning that we
could go past the limit in a single loop iteration.