Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automated XRD_PARALLELEVTLOOP settings #1425

Closed
apeters1971 opened this issue Mar 11, 2021 · 2 comments
Closed

Automated XRD_PARALLELEVTLOOP settings #1425

apeters1971 opened this issue Mar 11, 2021 · 2 comments
Assignees
Milestone

Comments

@apeters1971
Copy link
Contributor

apeters1971 commented Mar 11, 2021

While running some high-performance benchmark of a multithreaded application on a 100GE client,
we noticed, that although our storage endpoint can deliver 20 GiB/s, a single application was limited to ~2.5 GiB/s data input (single multithreaded application running 85% idle) (streaming many files in parallel)

After some investigation, it turned out, that setting:
env XRD_PARALLELEVTLOOP=16

allowed to run this application at 5.8 GiB/s

This ticket is about the possibility of some automatic configuration of the eventloop size in XrdCl to avoid tweaking the settings for each environment.

@amadio
Copy link
Member

amadio commented Jul 4, 2023

We've just increased the default value of XRD_PARALLELEVTLOOP to 10, which should be enough in most situations. Should we proceed to close this ticket, or is there still the need to have a better approach which dynamically sets the number using some heuristics?

@amadio amadio assigned amadio and unassigned simonmichal Jul 4, 2023
@apeters1971
Copy link
Contributor Author

I think that is good enough.

@amadio amadio added this to the 5.6.0 milestone Sep 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants