Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add a simple spillable queue #85

Merged
merged 2 commits into from
Feb 23, 2023
Merged

Add a simple spillable queue #85

merged 2 commits into from
Feb 23, 2023

Commits on Feb 23, 2023

  1. Add a Queue that can spill to disk 

    A spillable queue that is divided to segments of a fixed size. Each
segment can be spilled or loaded from disk on demand.
This queue support pre loading, and background flushes of segments

1. Background flushes of mutable segments to disk. A background flush
   would happen for at most one segment at a time to prevent an over subscription.
2. Background pre-loading of the next on disk segment. Once the
   currently dequeued segment's capacity reaches to 50% of the flush limit, the next
   segment would be scheduled to be loaded in the background.
    @igalshilman
    igalshilman committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    dc253c6 View commit details
    Browse the repository at this point in the history

  2. Don't use unstable features

    @igalshilman
    igalshilman committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    730c054 View commit details
    Browse the repository at this point in the history