Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closing an IndexReader on an already relocated / closed shard can cause memory leaks #5825

Closed
s1monw opened this issue Apr 16, 2014 · 1 comment
Labels
>bug :Distributed/Engine Anything around managing Lucene and the Translog in an open shard. v1.1.1 v1.2.0 v2.0.0-beta1

Comments

@s1monw
Copy link
Contributor

s1monw commented Apr 16, 2014

LUCENE-5553 can prevent ReaderClosedListener from being called if the indexreader is closed and the shard was already closed or relocated. This has been fixed in Lucene 4.7.1 and will be part of the next bugfix release for the 1.1.x series. We can't backport this to the 1.0.x series since this branch is running on LUCENE_46

The problem with this bug is that we never release the fielddata or filters that are associated with the index reader that runs into this bug. If the index is moved away from a node the memory is free again as well as during shard cleanups so in production this might not be a huge issue. Yet, there are node level services like the circuit-breaker that relies on the ReaderClosedListener to be invoked to adjust memory which can report wrong memory consumptions for the rest of it's lifetime.

@s1monw
Copy link
Contributor Author

s1monw commented Apr 16, 2014

fixed by 42b20d6

@s1monw s1monw closed this as completed Apr 16, 2014
@clintongormley clintongormley added :Distributed/Distributed A catch all label for anything in the Distributed Area. If you aren't sure, use this one. :Distributed/Engine Anything around managing Lucene and the Translog in an open shard. and removed :Engine :Distributed/Distributed A catch all label for anything in the Distributed Area. If you aren't sure, use this one. labels Feb 13, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>bug :Distributed/Engine Anything around managing Lucene and the Translog in an open shard. v1.1.1 v1.2.0 v2.0.0-beta1
Projects
None yet
Development

No branches or pull requests

2 participants