Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

return a generator from the sampler #12

Merged
merged 3 commits into from
Feb 28, 2021
Merged

Conversation

nealio82
Copy link
Contributor

for big data sets, returning an array from the sampler means we quickly run out of memory. it's not efficient to do everything all at once, so we can just return the data one row at a time instead

@nealio82 nealio82 force-pushed the use-generators-to-return-rows branch 2 times, most recently from ed5dabc to 8d5449f Compare February 28, 2021 13:14
@nealio82 nealio82 force-pushed the use-generators-to-return-rows branch from 8d5449f to 62d7241 Compare February 28, 2021 13:15
@nealio82 nealio82 linked an issue Feb 28, 2021 that may be closed by this pull request
@nealio82 nealio82 merged commit a716b61 into main Feb 28, 2021
@nealio82 nealio82 deleted the use-generators-to-return-rows branch February 28, 2021 13:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

use generators
1 participant