Tracking Issue: Lossy compression and storage in Vortex

[connortsui20]

This is a tracking issue for adding the ability to express "lossy" compression and data in Vortex.

Motivation

There has been recent work with the TurboQuant quantization scheme, which purposefully is not a lossless compression scheme. Right now, we do not have a way to express that an column / struct field is allowed to be qunatized.

Design

TODO

Steps

• Initial implementation
• Documentation
• Public API stabilization

Unresolved questions

• None yet.

Implementation history

[connortsui20]

We might not actually want to do this at all. Closing for now.