Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor Vortex compressor #291

Open
gatesn opened this issue May 2, 2024 · 2 comments
Open

Refactor Vortex compressor #291

gatesn opened this issue May 2, 2024 · 2 comments
Assignees

Comments

@gatesn
Copy link
Contributor

gatesn commented May 2, 2024

The current compressor implements a single strategy based on sampling. But it's a bit of a hammer. Encodings have to decide themselves, in isolation, whether they should or shouldn't be included in the search space.

Instead, I think we want these broader compression strategies to be aware of the codecs they can run over. We could explicitly implement BtrBlocks, using their chosen set of encodings. Or we could implement a configurable statistical strategy, or anything else.

As part of this, we should pull the strategy implementations into a trait. The API for encodings to implement could be stripped down, or even removed entirely and left up to the strategy.

@gatesn gatesn changed the title Pull out vortex-compress create Refactor Vortex compressor Jun 19, 2024
@robert3005
Copy link
Member

with #422 we can start building alternative compression strategy

@danking danking self-assigned this Sep 18, 2024
@lwwmanning
Copy link
Member

relatedly #128

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants