Option for DAS query in ConfigBuilder 76X

[yetkinyilmaz]

Two options added in order to pass options to DAS query, separately for main input and pile-up.
Initially needed in order to add larger sample when mixing (das_client.py --limit 0), however instead of coding this option in, a more generic flexibility was suggested ( @franzoni ).
One problem is if the dataset is too large (i.e. more than 600 files), the line:
https://github.com/yetkinyilmaz/cmssw/blob/das_query_76X_03/Configuration/Applications/python/ConfigBuilder.py#L140
gets stuck. This has to be fixed independently afterwards by more expert developers.

[cmsbuild]

A new Pull Request was created by @yetkinyilmaz for CMSSW_7_6_X.

Option for DAS query in ConfigBuilder 76X

It involves the following packages:

Configuration/Applications

@cmsbuild, @franzoni, @davidlange6 can you please review it and eventually sign? Thanks.
@ghellwig, @Martin-Grunewald this is something you requested to watch as well.
You can sign-off by replying to this message having '+1' in the first line of your reply.
You can reject by replying to this message having '-1' in the first line of your reply.
If you are a L2 or a release manager you can ask for tests by saying 'please test' in the first line of a comment.
@Degano you are the release manager for this.
You can merge this pull request by typing 'merge' in the first line of your comment.

[davidlange6]

@yetkinyilmaz - the fix to your output-too-large problem is to avoid filling the linux buffer and move the p.stdout.read() line above the os.waitpid line

    tupleP = os.waitpid(p.pid, 0)
    eC=tupleP[1]
    count=count+1
    pipe=p.stdout.read()

[yetkinyilmaz]

Thanks David, it works. I updated the two pull-requests for 76X and 75X.

On 18/08/15 14:51, David Lange wrote:

@yetkinyilmaz https://github.com/yetkinyilmaz - the fix to your
output-too-large problem is to avoid filling the linux buffer and move
the p.stdout.read() line above the os.waitpid line

|tupleP = os.waitpid(p.pid, 0) eC=tupleP[1] count=count+1
pipe=p.stdout.read() |

—
Reply to this email directly or view it on GitHub
#10838 (comment).

[cmsbuild]

Pull request #10838 was updated. @cmsbuild, @franzoni, @davidlange6 can you please check and sign again.