-
Notifications
You must be signed in to change notification settings - Fork 16
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TreeIndex slow memory reclamation #66
Comments
Thanks for reporting this. I've briefly tested the scenario, and it indeed seems problematic. Actually, it is not a leak, instead, |
Add a test case whether `TreeIndex` leaks memory.
It will take some time to fix the issue. Expediting memory reclamation is not as simple as I expected. |
The fix speeds memory reclamation up by a factor of 3; not quite satisfactory, that it is the best that I can get in short time. Hope that it will help. |
traverse several leaf nodes on every node deletion to release strong references earlier.
more aggressive memory reclamation applied. |
Yet another node reclamation method will be implemented in 0.7.0. |
It seems like
TreeIndex
will leak significant amounts of memory with large number of insertions. I'm trying to insert a few billion records into a TreeIndex, with periodically cleaning it, like so:I can observe the memory use keeps climbing even though i call
clear()
to try to control it.I'm using 0.6 for these tests.
The text was updated successfully, but these errors were encountered: