Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow jsocClient to download .tar archives from JSOC #4405

Merged
merged 10 commits into from
Sep 2, 2020

Conversation

lzivadinovic
Copy link
Contributor

Description

This PR allows JSOCClient to download all staged files as single .tar archive while still maintaining file list in base object.

Fixes #4291

@lzivadinovic lzivadinovic requested a review from a team as a code owner August 3, 2020 14:18
@pep8speaks
Copy link

pep8speaks commented Aug 3, 2020

Hello @lzivadinovic! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

There are currently no PEP 8 issues detected in this Pull Request. Cheers! 🍻

Comment last updated at 2020-09-02 16:23:46 UTC

@nabobalis nabobalis added this to the 2.1 milestone Aug 3, 2020
@nabobalis nabobalis added the net Affects the net submodule label Aug 3, 2020
sunpy/net/jsoc/jsoc.py Outdated Show resolved Hide resolved
@Cadair
Copy link
Member

Cadair commented Aug 19, 2020

Thanks for opening this PR, sorry I was a bit slow getting to it. I have one major question, but otherwise it looks great.

@lzivadinovic
Copy link
Contributor Author

I have one question regarding this PR. So, sunpy support Protocol as jsoc.attr but not Method, is there any special reason for this? It felt awkward for me to include protocol in request_data because we support it via attr, so i've omitted it. Also, if we want to support method as jsoc.attr i can add that to PR.

Copy link
Member

@Cadair Cadair left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like it's basically there.

sunpy/net/jsoc/jsoc.py Outdated Show resolved Hide resolved
changelog/4405.feature.rst Outdated Show resolved Hide resolved
Comment on lines 447 to 448
cd = drms.Client(email=block.get('notify', ''))
protocol = block.get('protocol', 'fits')
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't have to fix this here, but it feels weird that email, protocol and notify are not all the same?

sunpy/net/jsoc/jsoc.py Outdated Show resolved Hide resolved
sunpy/net/jsoc/jsoc.py Outdated Show resolved Hide resolved
Co-authored-by: Nabil Freij <nabil.freij@gmail.com>
@nabobalis
Copy link
Contributor

Stupid question: To use fido with this, you would pass in method=url-tar to fetch?

@Cadair
Copy link
Member

Cadair commented Sep 2, 2020

Stupid question: To use fido with this, you would pass in method=url-tar to fetch?

This doesn't add Fido support at the moment

@nabobalis nabobalis added the Merge When CI Passes Hit that merge button when it's all green! label Sep 2, 2020
@lzivadinovic
Copy link
Contributor Author

Should i rebase this PR?

@Cadair
Copy link
Member

Cadair commented Sep 2, 2020

It seems read the docs is just very upset, I think we are fine to merge this as expected fails.

@Cadair Cadair merged commit f033008 into sunpy:master Sep 2, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Merge When CI Passes Hit that merge button when it's all green! net Affects the net submodule
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support url-tar method downloads in the JSOCClient
4 participants