-
Notifications
You must be signed in to change notification settings - Fork 0
bd-resilient-kv: add versioned store #307
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
67 commits
Select commit
Hold shift + click to select a range
55fb6b7
bd-resilient-kv: add versioned store
snowp 773c679
add versioned recovery, zlib compression
snowp bca695f
bd-resilient-kv: add snapshot cleanup utility for archived journals
snowp 1c64982
make async
snowp edee87c
better compression, allows, +
snowp 5e83fa7
revert
snowp a2a7dcc
add u64 helper
snowp a22768f
only read from latest journal
snowp ebc6c06
docs(bd-resilient-kv): update documentation to reflect async API changes
snowp 96394a2
test(bd-resilient-kv): add test verifying rotation with many unique keys
snowp 6eae295
Revert "test(bd-resilient-kv): add test verifying rotation with many …
snowp 30a18b8
docs(bd-resilient-kv): document rotation buffer overflow impossibility
snowp f14c523
use timestamp as version
snowp 70a112b
use flate2 to avoid pulling in minz_oxide
snowp aa19899
update some docs
snowp f0910bd
some more docs
snowp bcef819
simplify tests
snowp fb1b250
use 5
snowp 4fd4947
remove base_timestamp, not needed
snowp 127f8ad
remove cleanup for now
snowp f00945c
remove rotation callback
snowp 8045327
update docs
snowp fb10cb8
revert cargo
snowp 163c53c
update docs
snowp 2bbc81e
simplify docs
snowp 790a533
simplify recovery
snowp cf732ee
only consider snapshots in recovery
snowp 747ea7f
remove tests we don't need
snowp 6d7ae28
docs updates
snowp 109f740
cleanup docs
snowp f5c826d
better docs
snowp 520a607
use microseconds
snowp 7f16d98
revert readme
snowp 5311501
more cleanup
snowp 421cd8b
remove
snowp 6e58b88
clean up tests
snowp 73ed8c3
remove unused
snowp 6e5eb56
use generation
snowp 27cdc5d
use proto
snowp 04c2d09
Merge branch 'main' of github.com:bitdriftlabs/shared-core into versi…
snowp 16cce68
fix tests
snowp d29e75f
propagate failures, improve errors
snowp 8470cf5
clippy
snowp c96c20e
docs fixes, naming
snowp ac9d000
use protobuf for varint encoding
snowp fbbd0c8
simplify
snowp 651fe5f
clean up framing
snowp e413633
renames, move stuff around
snowp 4ee6510
fixes
snowp af5c3a1
remove
snowp 631ddb7
revert
snowp 45fdec6
revert
snowp 7feb85f
comments
snowp 93e5f46
add more tests
snowp 5498458
use time provider
snowp 35abc73
simplify rotation code, use tokio fs where possible
snowp 1047e02
mode mod
snowp afb6d3e
clippy
snowp 8b266bf
update api
snowp 89f9a56
use varint for length
snowp 2aca5d0
add license headers
snowp 2be28cd
propagate partial failure case, remove read() in favor of ctor arg
snowp 1d26a05
clippy
snowp 3004014
impprove rotation
snowp 23bd853
clippy
snowp 518fb23
simplify
snowp 6f19078
refactor
snowp File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -17,4 +17,5 @@ pub mod logging; | |
| pub mod mme; | ||
| pub mod prometheus; | ||
| pub mod pulse; | ||
| pub mod state; | ||
| pub mod workflow; | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| pub mod payload; |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should make sure this does the right thing with flate2 in terms of using system zlib otherwise maybe better to do it manually.