Data limit?

[caterpillars]

Hi,

It seems that there is a limit of how much data you can read? Whenever I read more data ( a fat table or a skinny long table), the reading is not successful and it only returns partial data or nothing. Is there anyway to get around this?

Thanks,

Hongli

[tylertreat]

There is a practical limit, yes, but that's a limitation of Google's API. You should be paginating your results. This library doesn't currently expose the page token, but when you submit a query, the results are saved to a temporary table. From there, you can safely paginate using the offset and limit kwargs of get_query_rows.

[caterpillars]

Thanks, will try that.

[tylertreat]

You might also refer to allowLargeResults (see #50).

[caterpillars]

Thanks for the info. Will you make this keywords exposed?

On Fri, Mar 20, 2015 at 9:32 AM, Tyler Treat notifications@github.com
wrote:

You might also refer to allowLargeResults (see #50
#50).

—
Reply to this email directly or view it on GitHub
#49 (comment)
.

[tylertreat]

Been pretty busy lately but I will try to get to it soon. Otherwise I will accept PRs if someone wants to take a crack at it sooner.

[caterpillars]

Thanks for the info.

On Fri, Mar 20, 2015 at 12:13 PM, Tyler Treat notifications@github.com
wrote:

Been pretty busy lately but I will try to get to it soon. Otherwise I will
accept PRs if someone wants to take a crack at it sooner.

—
Reply to this email directly or view it on GitHub
#49 (comment)
.

[tylertreat]

Addressed with #56.