Deleting data in bookkeeper #23032

ub-3 · 2024-07-14T22:22:14Z

ub-3
Jul 14, 2024

Will the ledger be deleted if a rollover occurred according to the parameters: managedLedgerMaxLedgerRolloverTimeMinutes, m
anagedLedgerMinLedgerRolloverTimeMinutes, managedLedgerMaxEntriesPerLedger, but the cursor ledger was not closed.
And another question. If compaction is disabled on the bookkeeper side, will the entry log be deleted when closing ledger?

Answered by sbourkeostk

A topic (managed-ledger) consists of a set of ledgers. When a ledger is rolled over the previous ledger is only removed if all cursors have moved past its entries (assuming no retention/TTLs).
BookKeeper has no concept/knowledge of compaction, that's a Pulsar concept. As in question 1, a ledger is only deleted when the broker that responsible for the topic deletes the ledger from bookkeeper. The broker will not do that until: all messages stored in the ledger have been ack'd on all subscriptions or the TTL has expired, and the retention window has passed.

sbourkeostk · 2024-08-07T15:46:54Z

A topic (managed-ledger) consists of a set of ledgers. When a ledger is rolled over the previous ledger is only removed if all cursors have moved past its entries (assuming no retention/TTLs).
BookKeeper has no concept/knowledge of compaction, that's a Pulsar concept. As in question 1, a ledger is only deleted when the broker that responsible for the topic deletes the ledger from bookkeeper. The broker will not do that until: all messages stored in the ledger have been ack'd on all subscriptions or the TTL has expired, and the retention window has passed.

0 replies