New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
max conns to JSOC is always 1 #5714
Conversation
6d9b3c2
to
8404e1a
Compare
It seems a bit extreme to force only 1 max_split and max_conn. Is it possible to just make the defaults 1? |
JSOC say it should only be one and I think we should not let users change this. |
aa72b40
to
07b3dff
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I would like to consider the knock-on impacts this has on mixed-client downloads and the general poor experience for people who are now used to parallel downloads even when just downloading from JSOC.
6242b0a
to
d377415
Compare
I am treating this as a bugfix for backporting, if we merge this then a second PR actually removing all these kwargs needs opening. As this is (with out the max_conn setting through Fido) I am 👍 on this, I have no issue with completely disabling chunked downloads for JSOC at their behest. That being said, I do wonder if there is any point in the max_conn changes in this PR, as it only affects people directly using the JSOCClient, and it's easy to override even for them by passing through a new |
To be clear, the proper long term fix here is Cadair/parfive#39 where the JSOCClient can say to parfive "only one connection at once to jsoc.stanford.edu please" and it can have 10,000 open connections to somewhere else at the same time for all JSOCClient cares. |
Is there any reason to not wait on that fix then and just pin to the latest version of parfive or higher? EDIT: I thought that was a PR, but it is just an issue 😅 |
You mean remove the keyword in the fetch for jsoc or in the downloader? |
I will manually backport to each. |
No description provided.