Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Download data only when present at all of X sites #49

Open
mjones01 opened this issue Apr 11, 2019 · 2 comments
Open

Download data only when present at all of X sites #49

mjones01 opened this issue Apr 11, 2019 · 2 comments

Comments

@mjones01
Copy link
Contributor

This request originated from Erin Crandall.
It would be nice to have an option in zipsByProduct() and loadByProduct() where data was only downloaded/loaded if it was available from all the sites listed within a data range. E.g. Between Jan 2013 and Dec 2018, only download data if X product is available from all of HARV|BART|CLBJ.

Describe alternatives you've considered
This is possible to do post downloading but with data products that have large quantities of data one still has to deal with the large download size of data that isn't of interest. This also put additional data management burden on the data user.

@mjones01
Copy link
Contributor Author

I'd actually misunderstood the original request which is about two different data products: Ability to query sites that have both of 2 different data products available. For example, I want data from all the sites that have fish data and stream geomorphology surveys done in an overlapping time range. I want to see all the sites that have both types of data available and download only those.

@cklunch
Copy link
Collaborator

cklunch commented Apr 12, 2019

Thanks for the suggestion! Building this into the download functions directly would be a bit cumbersome, but I can definitely make some enhancements to the catalog-querying functions to produce a clean summary of availability, which would give you the info you'd need.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants