Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

streamingccl: ensure destination tenant is garbage collected #86020

Open
2 tasks
stevendanna opened this issue Aug 12, 2022 · 2 comments
Open
2 tasks

streamingccl: ensure destination tenant is garbage collected #86020

stevendanna opened this issue Aug 12, 2022 · 2 comments

Comments

@stevendanna
Copy link
Collaborator

stevendanna commented Aug 12, 2022

To ensure that the destination cluster does not grow without bounds, we need to ensure that the ranges related to this tenant span are garbage collected. This likely requires that we:

  • Periodically send a RecomputeStats RPC to every range we are ingesting into since we don't currently compute stats during AddSST.
  • Provide the user some means to configure the TTL for the tenant. Span configurations from the source cluster may not be visible to the destination host since the tenant itself won't actually be running during the replication process.

Jira issue: CRDB-18529

Epic CRDB-19048

@blathers-crl
Copy link

blathers-crl bot commented Aug 12, 2022

Hi @stevendanna, please add a C-ategory label to your issue. Check out the label system docs.

While you're here, please consider adding an A- label to help keep our repository tidy.

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is otan.

@stevendanna stevendanna added this to the 23.1 milestone Aug 12, 2022
@stevendanna stevendanna changed the title streamingccl: ensure destination cluster runs GC streamingccl: ensure destination tenant is garbage collected Aug 12, 2022
@blathers-crl
Copy link

blathers-crl bot commented Aug 26, 2022

cc @cockroachdb/bulk-io

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

No branches or pull requests

1 participant