Skip to content
This repository has been archived by the owner on Mar 9, 2019. It is now read-only.

Improve bulk load performance #94

Closed
benbjohnson opened this issue Mar 25, 2014 · 1 comment
Closed

Improve bulk load performance #94

benbjohnson opened this issue Mar 25, 2014 · 1 comment
Assignees
@benbjohnson
Labels
optimization
Milestone
v0.1.0

Comments

@benbjohnson
Copy link
Member

Bulk loading more than 1000 items at a time is very slow. This is because nodes are not splitting before commit which causes large memmove() operations during insertion.

This should be (relatively) easy to fix.
@benbjohnson benbjohnson added this to the v0.1.0 milestone Mar 25, 2014
@benbjohnson benbjohnson self-assigned this Mar 25, 2014
This was referenced Mar 25, 2014
Closed
Merged
@benbjohnson benbjohnson mentioned this issue Apr 3, 2014
Closed
@benbjohnson benbjohnson mentioned this issue May 2, 2014
Merged
@benbjohnson
Copy link
Member Author

This only occurs with the initial batch of updates since they all go into the same bucket. After the first commit they spread out pretty evenly. Not worth the complexity to try to implement this at this time.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@benbjohnson benbjohnson

Labels
optimization
Projects
None yet
Milestone
v0.1.0
Development

No branches or pull requests
1 participant
@benbjohnson