Skip to content

Defer commitlog compression when under load #4974

Merged
jdetter merged 3 commits intomasterfrom
joshua/deferred-compression
May 7, 2026
Merged

Defer commitlog compression when under load #4974
jdetter merged 3 commits intomasterfrom
joshua/deferred-compression

Conversation

@joshua-spacetime
Copy link
Copy Markdown
Collaborator

@joshua-spacetime joshua-spacetime commented May 7, 2026

Description of Changes

Defers commitlog segment compression until write load has been idle for a short window, while still forcing progress when the uncompressed segment backlog grows too large.

This tries to avoid creating a durability backlog that eventually blocks the main execution thread.

API and ABI breaking changes

None

Expected complexity level and risk

2

Testing

TODO

@joshua-spacetime joshua-spacetime force-pushed the joshua/deferred-compression branch from ff4fac5 to b711be2 Compare May 7, 2026 05:12
@joshua-spacetime joshua-spacetime force-pushed the joshua/deferred-compression branch from b711be2 to 983817c Compare May 7, 2026 06:03
@joshua-spacetime joshua-spacetime requested a review from kim May 7, 2026 06:05
@jdetter jdetter disabled auto-merge May 7, 2026 15:04
@jdetter jdetter enabled auto-merge May 7, 2026 15:04
@jdetter jdetter changed the title Defer commitlog compression when under load Defer commitlog compression when under load May 7, 2026
@jdetter jdetter added this pull request to the merge queue May 7, 2026
Merged via the queue into master with commit ca1b45f May 7, 2026
31 checks passed
@joshua-spacetime joshua-spacetime deleted the joshua/deferred-compression branch May 7, 2026 17:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants