Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write-through cache reintroduced #134

Merged
merged 5 commits into from
Aug 22, 2023
Merged

Write-through cache reintroduced #134

merged 5 commits into from
Aug 22, 2023

Conversation

Scooletz
Copy link
Contributor

@Scooletz Scooletz commented Aug 21, 2023

After merging maps with #131, this PR reintroduces the in page write-through cache. This should again reduce the write amplification. Additionally, it should make it much easier to deal with tombstone management and deciding what to do with the deletes and how to propagate them.

Connected with #122

Benchmarks

The dry runs of Paprika.Runner show huge improvement in speed and density of writes

In-memory

image

@Scooletz Scooletz mentioned this pull request Aug 21, 2023
5 tasks
@Scooletz Scooletz marked this pull request as ready for review August 22, 2023 09:08
@github-actions
Copy link

Code Coverage

Package Line Rate Branch Rate Health
Paprika 88% 78%
Summary 88% (2197 / 2483) 78% (566 / 724)

Minimum allowed line rate is 75%

@Scooletz Scooletz merged commit 6f23ee1 into main Aug 22, 2023
2 checks passed
@Scooletz Scooletz deleted the write-through-cache branch August 22, 2023 09:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant