storage: bounded EFOS pinning #122139
Labels
A-storage
Relating to our storage engine (Pebble) on-disk storage.
C-enhancement
Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception)
T-storage
Storage Team
Projects
Comments
jbowens
added
C-enhancement
jbowens
added a commit
to jbowens/cockroach
that referenced
this issue
Apr 10, 2024
Add a new timeseries metric that provides visibility into the volume of data that exists in sstables that are not part of the most recent version of the LSM. Epic: none Informs cockroachdb#121935. Informs cockroachdb#122139. Informs cockroachdb/pebble#3500. Close cockroachdb#122110. Release note (ops change): Adds a new timeseries metric storage.sstable.zombie.bytes.
craig bot
pushed a commit
that referenced
this issue
Apr 11, 2024
122152: kvserver: add storage.sstable.zombie.bytes metric r=RaduBerinde a=jbowens Add a new timeseries metric that provides visibility into the volume of data that exists in sstables that are not part of the most recent version of the LSM. Epic: none Informs #121935. Informs #122139. Informs cockroachdb/pebble#3500. Close #122110. Release note (ops change): Adds a new timeseries metric storage.sstable.zombie.bytes. Co-authored-by: Jackson Owens <jackson@cockroachlabs.com>
blathers-crl bot
pushed a commit
that referenced
this issue
Apr 11, 2024
Add a new timeseries metric that provides visibility into the volume of data that exists in sstables that are not part of the most recent version of the LSM. Epic: none Informs #121935. Informs #122139. Informs cockroachdb/pebble#3500. Close #122110. Release note (ops change): Adds a new timeseries metric storage.sstable.zombie.bytes.
andrew-delph
pushed a commit
to andrew-delph/cockroach
that referenced
this issue
Jun 20, 2024
Add a new timeseries metric that provides visibility into the volume of data that exists in sstables that are not part of the most recent version of the LSM. Epic: none Informs cockroachdb#121935. Informs cockroachdb#122139. Informs cockroachdb/pebble#3500. Close cockroachdb#122110. Release note (ops change): Adds a new timeseries metric storage.sstable.zombie.bytes.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Cockroach repository companion issue for cockroachdb/pebble#3500. Now that we use "eventually file-only snapshots," we're more susceptible to space amplification from long-running operations that keep an iterator version pinned. To reduce the space amplification, we can take advantage of an EFOS's bounds to only pin sstables that the EFOS will read.
Jira issue: CRDB-37724
Epic CRDB-37583
The text was updated successfully, but these errors were encountered: