Expand WASAPI Limits

[amhanson9]

WASAPI calls currently have a limit of 1000 WARCs and we have more than that now. Test if -1 works to get all (that works with the Partner API) or else increase the current limit.

[amhanson9]

Considered if it isn’t a problem, since we usually are getting the WARCs for a quarter, and that is still well under 1000. But there may be times we want all our metadata in one CSV, so do want the ability to get everything.

[amhanson9]

Page limit of -1 does not work with WASAPI. It gives the default limit of 100. Have to expand the page limit number: see WASAPI help page

[amhanson9]

Solution: use a standard page number, but if the count returned from WASAPI is larger than that page number, call WASAPI again using count as the page number. Using 500, which is plenty for our quarterly downloads.