Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use arcgislayers as backend for ESRI's AGOL #109

Closed
kbvernon opened this issue Jan 18, 2024 · 12 comments
Closed

Use arcgislayers as backend for ESRI's AGOL #109

kbvernon opened this issue Jan 18, 2024 · 12 comments

Comments

@kbvernon
Copy link

Hi Kyle, I think I mentioned this to you before, but I want to suggest adopting {arcgislayers} as a backend for interacting with ESRI's AGOL. That package is going through some additional testing, but I believe it should reach a stable version in the next couple of weeks or month.

Benefits:

  1. {arcgislayers} is officially supported by ESRI. That's maybe not a great argument... but!
  2. It would remove a ton of code from {FedData} that you would no longer have to maintain.
  3. It would make it easier to introduce some functionality that we've talked about before, like query support (Feature Request: NHD Query Support #68) and attribute/column selection.
  4. And, it can be done without introducing breaking changes.

Costs:

  1. Maybe AWS is better? (I have almost no experience with AWS and am not sure this is entirely true, so take it for what it is.)
  2. {arcgislayers} is built around the idea of interacting with AGOL (upload, download, query, retrieve metadata, etc), so there's a risk of mission creep.

Just to give an example of the trade-off here, {arcgislayers} gives you the power to query AGOL and return a table without spatial data, which is nice for exploring data before figuring out what features to download. It also allows you to specify what attribute data you want to get. But right now, {FedData} always returns all of the spatial and attribute data. My own feeling is that the benefits of filtering rows and selecting columns outweigh the potential risks, but a hardline should definitely be drawn there.

Also, get_nhd() will require some special treatment since it returns a list. My guess is additional functions for retrieving individual components of NHD, so that uber function can be left alone.

What do you think?

If it helps, this is something I would be more than willing to invest some time. Least I can do since this package factors so heavily in all of my research.

@bocinsky
Copy link
Collaborator

bocinsky commented Jan 18, 2024 via email

@kbvernon
Copy link
Author

Thanks, Kyle! I'm going to wait till they release a stable version before I start working on this (probably mid-February), then I can share a PR.

Cheers.

@bocinsky
Copy link
Collaborator

bocinsky commented Jan 18, 2024 via email

@JosiahParry
Copy link

If you all end up taking this on, please let me know if I can be of assistance! I'm sure y'all will run into some "nice to haves" and if you do, please let me know. Additionally, if there is any progress made on this before March 10th-ish, I'd love to talk about it at Esri DevSummit

@bocinsky
Copy link
Collaborator

Will do. Thanks @JosiahParry!

@bocinsky
Copy link
Collaborator

Hi y'all. I've begun the implementation of this, first by simply using arcgislayers without changes to the FedData api. So, query support requested in (#68) is not yet implemented. But it works well, and I'm pleased to rely on an official ESRI package for accessing ArcGIS layers.

That being said, we can't release this update to CRAN until arcgislayers is on CRAN. I didn't put two and two together about this until I'd already implemented it. @JosiahParry, any notion on if/when a CRAN release of arcgislayers is likely to happen?

@JosiahParry
Copy link

Yup! Totally fair point. :)))
@bocinsky The goal is a CRAN release within the next few weeks. Before March 12! I need to sniff out as many bugs as possible and fix them before then. So...if you have any that you've encountered please do let me know. I'll keep you posted on this. Sorry for the headache!

@bocinsky
Copy link
Collaborator

bocinsky commented Feb 12, 2024 via email

@JosiahParry
Copy link

arcgisutils 0.2.0 is released on CRAN

arcgislayers is waiting for review: https://cran.r-project.org/incoming/newbies/

@bocinsky
Copy link
Collaborator

bocinsky commented Feb 26, 2024 via email

@JosiahParry
Copy link

@bocinsky
Copy link
Collaborator

Great news! Installed and running checks now for FedData resubmission to CRAN

@bocinsky bocinsky closed this as completed Apr 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants