Skip to content
This repository has been archived by the owner on Aug 13, 2019. It is now read-only.

Align series to 8/16byte padding to increase addressable space #238

Closed
gouthamve opened this issue Dec 28, 2017 · 1 comment
Closed

Align series to 8/16byte padding to increase addressable space #238

gouthamve opened this issue Dec 28, 2017 · 1 comment

Comments

@gouthamve
Copy link
Collaborator

prometheus/prometheus#3190 is because we store the offset to series data in the index and we store in a uint32 giving us only 4GB of addressable space.

To increase it, we can use an uint64 but that would double the postings space required and compression would mean a good chunking mechanism.

Alternately, @fabxc came up with this brilliant idea of aligning the offsets to 8/16bytes and that would mean we just store the multiple of 8/16 bytes, giving us upto 64GB of addressable space.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants