RSocrata hangs when passing along SoDA queries with small number of results

[tomschenkjr]

When passing queries that yield few results seems to cause RSocrata to hang. While there were a few permutations, the examples below demonstrate the issue while each one was successful through hurl.it.

read.socrata("https://data.cityofchicago.org/resource/xzkq-xp2w.json?$limit=500") # Success
read.socrata("https://data.cityofchicago.org/resource/xzkq-xp2w.json?$limit=250") # Success
read.socrata("https://data.cityofchicago.org/resource/xzkq-xp2w.json?$limit=100") # Success
read.socrata("https://data.cityofchicago.org/resource/xzkq-xp2w.json?$limit=50") # Success
read.socrata("https://data.cityofchicago.org/resource/xzkq-xp2w.json?$limit=25") # Hangs
read.socrata("https://data.cityofchicago.org/resource/xzkq-xp2w.json?$limit=10") # Hangs
read.socrata("https://data.cityofchicago.org/resource/xzkq-xp2w.json?$limit=5") # Hangs
read.socrata("https://data.cityofchicago.org/resource/xzkq-xp2w.json?$limit=1") # Hangs

Stepping through the functions, the problem seems to arise when nrow(page) is small. Have not fully diagnosed the issue, yet.

[tomschenkjr]

@nicklucius - if I recall, you mentioned that the limit argument was being used improperly in RSocrata, so $limit=1 would only iterate a download at one record at a time. Correct?

If so, was that fixed?

[nicklucius]

@tomschenkjr - yes that's correct, for cross-reference it's #83. Tomorrow I'll have a pull request ready for the fix.

[tomschenkjr]

👍

_
Tom Schenk Jr.
Chief Data Officer
Department of Innovation and Technology
City of Chicago
tom.schenk@cityofchicago.org | @ChicagoCDO
data.cityofchicago.org | opengrid.io | digital.cityofchicago.org | chicago.github.io | dev.cityofchicago.org

On Tue, Oct 25, 2016 at 7:25 PM -0500, "Nick Lucius" <notifications@github.commailto:notifications@github.com> wrote:

@tomschenkjrhttps://github.com/tomschenkjr - yes that's correct, for cross-reference it's #83#83. Tomorrow I'll have a pull request ready for the fix.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com//issues/14#issuecomment-256217045, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ABkC0d6nPThVqiJKTeJzx48RHmiBZxmMks5q3p4JgaJpZM4DN7Qo.

---

This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail (or the person responsible for delivering this document to the intended recipient), you are hereby notified that any dissemination, distribution, printing or copying of this e-mail, and any attachment thereto, is strictly prohibited. If you have received this e-mail in error, please respond to the individual sending the message, and permanently delete the original and any copy of any e-mail and printout thereof.