Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SS table compression #54

Closed
3 tasks done
Terkwood opened this issue Jul 31, 2021 · 0 comments · Fixed by #81
Closed
3 tasks done

SS table compression #54

Terkwood opened this issue Jul 31, 2021 · 0 comments · Fixed by #81
Labels
enhancement New feature or request

Comments

@Terkwood
Copy link
Owner

Terkwood commented Jul 31, 2021 •
edited

Compress the blocks referred to by sparse index #46

design

Erlang stdlib has an interface to zlib, which looks like a good starting point. Use gzip method so that we can compare checksums of uncompressed payloads to the footer bytes of compressed payloads (#79 & #80).

tasks

  • rework dump : store gzipped payload
  • rework compaction : store gzipped payload
  • rework query

prereqs
@Terkwood Terkwood added the enhancement New feature or request label Jul 31, 2021
@Terkwood Terkwood pinned this issue Aug 1, 2021
@Terkwood Terkwood mentioned this issue Aug 3, 2021
Closed
@Terkwood Terkwood unpinned this issue Aug 3, 2021
@Terkwood Terkwood pinned this issue Aug 4, 2021
This was referenced Aug 4, 2021
Merged
Merged
Merged
@Terkwood Terkwood unpinned this issue Aug 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat: compress the SSTables Terkwood/AugustDB
1 participant
@Terkwood