[VOTE] Adopt Zone Map Version 1 #8302
westonpace
started this conversation in
Vote
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
The current zone map is version 0. Zone map version 1 adds support for null-only zone maps which do not store the min/max. These are used for tracking validity bitmaps and null/nan counts for nested data types where extrema does not make sense (struct / list).
There is a proposed PR here.
There have been some piecemeal approaches to this (see #8088 and #8089) but this comprehensive approach will allow us to make breaking changes in the seed serialization (we can encode the nullability bitmaps as binary instead of hex) and make it clearer to users that they need to upgrade their index.
All reactions