Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.
Sign upPCP-23-1: Update blob file format to accommodate zstd dictionary #108
Comments
This comment has been minimized.
This comment has been minimized.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
This is subtask of tikv/tikv#5743.
We need to add a new version to blob file format. If version = 2, it means the blob file come with a zstd dictionary and the dictionary is stored in the meta section (pointed by meta index handle in the footer). Update
BlobFileHeader
andBlobFileFooter
and their comments accordingly.Also update
BlobEncoder
andBlobDecoder
to allow passing in a dictionary and use it to compress/decompress. Add unit test for it.This should be a good warmup task for you to get familiar with Titan development.