Manual Compaction #45
Labels
question
Need more discussion
Comments
scottcarey
pushed a commit
to scottcarey/HaloDB
that referenced
this issue
Dec 3, 2019
Add the 'forceCompaction' method to HaloDB, which takes a compactionThreshold value and will trigger compaction on all files that have stale data above the threshold. Additionally clean up how pauseCompaction() works so that it awaits pending compactions.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
One of my use cases involves building a large K/V dataset in one location, then closing the data store, transfering and replicating the contents to other locations and initializing them elsewhere.
For this use case, I would like to have a method to do manual compaction.
Perhaps a method
void compact(float threshold)that compacts all data files that have more thanthresholdratio of overwritten bytes would be best. For example, callingcompact(0.01)would result in all files that have over 1% of their space deleted to be compacted.This could be used for my use case as well as several others. It also would be a useful tool for compaction performance measurement.
The text was updated successfully, but these errors were encountered: