Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Clone in Desktop Download ZIP

Loading…

Shutdown is too slow #59

Closed
mdcallag opened this Issue · 5 comments

2 participants

@mdcallag
Owner

The problem is the time required for RocksDB to call free on each block in the block cache. Sample stack traces during a slow shutdown are at https://gist.github.com/mdcallag/5ce2d163234ba8cc3bb0

By "too slow" I mean it takes ~30 seconds for RocksDB to shutdown when the block cache has ~15G of data

This might be fixed via "cache_->DisownData();" and see https://reviews.facebook.net/D34977

@maykov maykov self-assigned this
@maykov maykov referenced this issue from a commit
@maykov maykov Making shutdowns faster by calling DisownData
Summary: As above , see the issue #59

Test Plan: I tested for correcntess by looking at the log file and didn't see anything suspicious. I'll let Mark and Herman do testing at scale.

Reviewers: hermanlee4, MarkCallaghan

Reviewed By: MarkCallaghan

Differential Revision: https://reviews.facebook.net/D37785
4f4a2f6
@maykov maykov removed their assignment
@mdcallag mdcallag was assigned by maykov
@maykov
Owner

Let me know if it still slow.

@mdcallag
Owner
@maykov
Owner

It looks like I added disowning for the default column family LRU but not for the rest.

@maykov
Owner

Did you try with the per column family setting for the cache size? If so, this results in a creation of a separate lru cache for such families which we do not have an access to. Would you retry without that option? It is fine to provide the rocksdb_block_cache_size global option.

@mdcallag
Owner
@maykov maykov closed this
@maykov maykov referenced this issue from a commit
@maykov maykov Making shutdowns faster by calling DisownData
Summary: As above , see the issue #59

Test Plan: I tested for correcntess by looking at the log file and didn't see anything suspicious. I'll let Mark and Herman do testing at scale.

Reviewers: hermanlee4, MarkCallaghan

Reviewed By: MarkCallaghan

Differential Revision: https://reviews.facebook.net/D37785
1bc7073
@maykov maykov referenced this issue from a commit in facebook/mysql-5.6
@maykov maykov Making shutdowns faster by calling DisownData
Summary: As above , see the issue MySQLOnRocksDB#59

Test Plan: I tested for correcntess by looking at the log file and didn't see anything suspicious. I'll let Mark and Herman do testing at scale.

Reviewers: hermanlee4, MarkCallaghan

Reviewed By: MarkCallaghan

Differential Revision: https://reviews.facebook.net/D37785
170ad8d
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.