Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Java] Add benchmark and large fake data UT for avro adapter #22830

Closed
Tracked by #22264
asfimport opened this issue Sep 5, 2019 · 2 comments
Closed
Tracked by #22264

[Java] Add benchmark and large fake data UT for avro adapter #22830

asfimport opened this issue Sep 5, 2019 · 2 comments

Comments

@asfimport
Copy link

asfimport commented Sep 5, 2019

To avoid OOM, we have implement iterator API in ARROW-6220.

This issue is about to add tests with a large fake data set (say 6MM rows in JDBC adapter test) and ensures no OOMs occur.

 

Reporter: Ji Liu / @tianchen92
Assignee: Ji Liu / @tianchen92

Related issues:

PRs and other links:

Note: This issue was originally created as ARROW-6460. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Micah Kornfield / @emkornfield:
as part of this can we add in a performance test as well to get a baseline number.

@asfimport
Copy link
Author

Micah Kornfield / @emkornfield:
Issue resolved by pull request 5317
#5317

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants