New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hard to read complete data #40

Open
pawelpabich opened this Issue Aug 19, 2015 · 1 comment

Comments

Projects
None yet
1 participant
@pawelpabich
Contributor

pawelpabich commented Aug 19, 2015

The batch parameter on Scanner data structure controls how many cells (not rows) will be retrieved at a time. This means that for it be useful one needs to write code to combines the data from possibly multiple batches so only complete rows are returned to the client code. This might not be needed with stateless scanners #7 as they have limit parameter which operates on the row level.

I have a piece of code that does that and if there is enough appetite I can open a pull request.
The gist of it is here: https://gist.github.com/pawelpabich/53d5cfc3ef51a083a042. I also have set of tests that covers it.

@pawelpabich

This comment has been minimized.

Show comment
Hide comment
@pawelpabich

pawelpabich Aug 19, 2015

Contributor

One more thing, if you don't specify batch parameter then, in my experience, all gets returned at once which might cause Out of Memory exceptions along the way.

Contributor

pawelpabich commented Aug 19, 2015

One more thing, if you don't specify batch parameter then, in my experience, all gets returned at once which might cause Out of Memory exceptions along the way.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment