Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider query size cap or batch fetching for safety #133

Open
bluerogue251 opened this issue Nov 3, 2019 · 0 comments
Open

Consider query size cap or batch fetching for safety #133

bluerogue251 opened this issue Nov 3, 2019 · 0 comments

Comments

@bluerogue251
Copy link
Owner

Currently there is no maximum size on the amount of data we could pull into memory at once. It's dependent on:

  • What the user specifies as base query
  • What the cardinality of children to parents is (for instance, if one parent row has 5 billion children rows, we might pull all 5 billion into memory at once)

There may be some way to give more safety around memory use. For instance, by putting a cap on rows fetched, by using jdbc batches for selects, etc.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant