Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KAFKA-8323: Close RocksDBStore's BloomFilter #6672

Merged
merged 2 commits into from
May 3, 2019

Conversation

ableegoldman
Copy link
Contributor

Any RocksJava object that inherits from org.rocksdb.AbstractNativeReference must be closed explicitly in order to free up the memory of the backing C++ object. The BloomFilter extends RocksObject (which implements AbstractNativeReference) and should be also be closed in RocksDBStore#close to avoid leaking memory.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@ableegoldman
Copy link
Contributor Author

This should probably be cherry-picked to older versions? @bbejeck @guozhangwang @mjsax @vvcephei @cadonna @abbccdda

@bbejeck bbejeck added the streams label May 3, 2019
Copy link
Contributor

@bbejeck bbejeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @ableegoldman, LGTM will merge once build passes

@bbejeck
Copy link
Contributor

bbejeck commented May 3, 2019

This should probably be cherry-picked to older versions?

Yes, will do

@ableegoldman ableegoldman changed the title [HOT FIX] Close RocksDBStore's BloomFilter KAFKA-8323: Close RocksDBStore's BloomFilter May 3, 2019
@bbejeck bbejeck merged commit a1b1e08 into apache:trunk May 3, 2019
@bbejeck
Copy link
Contributor

bbejeck commented May 3, 2019

Merged #6672 to trunk

@bbejeck
Copy link
Contributor

bbejeck commented May 3, 2019

Thanks @ableegoldman!

@vahidhashemian
Copy link
Contributor

Thanks @ableegoldman and @bbejeck. Can we resolve the blocker JIRA then?

bbejeck pushed a commit that referenced this pull request May 4, 2019
Any RocksJava object that inherits from org.rocksdb.AbstractNativeReference must be closed explicitly in order to free up the memory of the backing C++ object. The BloomFilter extends RocksObject (which implements AbstractNativeReference) and should be also be closed in RocksDBStore#close to avoid leaking memory.

Reviewers: Bill Bejeck <bbejeck@gmail.com>
@bbejeck
Copy link
Contributor

bbejeck commented May 4, 2019

cherry-picked to 2.2

@vahidhashemian resolving the JIRA now

pengxiaolong pushed a commit to pengxiaolong/kafka that referenced this pull request Jun 14, 2019
Any RocksJava object that inherits from org.rocksdb.AbstractNativeReference must be closed explicitly in order to free up the memory of the backing C++ object. The BloomFilter extends RocksObject (which implements AbstractNativeReference) and should be also be closed in RocksDBStore#close to avoid leaking memory.

Reviewers: Bill Bejeck <bbejeck@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants