Skip to content
This repository has been archived by the owner on May 30, 2021. It is now read-only.

ArcGIS pagination #889

Closed
wants to merge 16 commits into from
Closed

Conversation

shaperilio
Copy link
Collaborator

This pull request is to replace #835; I'm trying to address @jzohrab's comment about not updating the cache submodule, but to be honest, I can't see when it was done, or how to undo it.

This would address #832.

All scrapers were migrated and eye-tested.

I've defined a transition date so that we don't get cache misses when building timeseries. In this PR the date's been changed:

const ARCGIS_PAGINATION_DEPLOY_DATE = '2020-04-25'

Please take a look if you haven't already looked at the old one. (Nothing's changed here other than bringing it up to date with master and changing the deploy date.

@shaperilio shaperilio changed the title Arc gis pagination ArcGIS pagination Apr 23, 2020
@shaperilio shaperilio requested a review from jzohrab April 23, 2020 20:16
@jzohrab
Copy link
Contributor

jzohrab commented Apr 24, 2020

Hi @shaperilio , my cache review was for this change:

image

You can (should be able to!) get rid of that by checking this branch out and updating that reference so it's referring to the same sha as in master. Ping if issues. :-)

@lazd
Copy link
Collaborator

lazd commented May 2, 2020

@camjc does this relate to the JP problem you noted?

@jzohrab
Copy link
Contributor

jzohrab commented May 31, 2020

fyi @shaperilio and anyone else -- I've pulled parts of this over to Li in (wip) PR covidatlas/li#193, and implemented it for JP. @shaperilio I reused your work for that, thanks. We still have to implement the paging for all the scrapers that Emilio did in this PR, so I'm leaving this open until I create another issue in Li.

@jzohrab
Copy link
Contributor

jzohrab commented Jul 26, 2020

New issue in Li covidatlas/li#350 covers the work in this PR, so I'm closing this one here. Thank you very much @shaperilio ! z

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants