Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[xCluster/Tablet Splitting] Support tablet splitting for bootstrapping streams #13170

Open
hulien22 opened this issue Jul 6, 2022 · 0 comments
Assignees
Labels
area/docdb YugabyteDB core features kind/enhancement This is an enhancement of an existing feature priority/medium Medium priority issue xCluster Label for xCluster related issues/improvements

Comments

@hulien22
Copy link
Contributor

hulien22 commented Jul 6, 2022

Jira Link: DB-2855

Description

Currently we disable tablet splits for any tables that have tablets that are in the INITIATED state. This is usually fine since the bootstrapping process shouldn't take too long. One potential issue here is that if a user initiates a bootstrap but never finishes setting up the full replication and don't clean up the INITIATED streams with delete_cdc_stream - in this case tablet splitting would continue being blocked until these streams get deleted.

To implement this, we need to do some work to handle bootstrap_cdc_producer and setup_universe_replication being called on a table with a different number of tablets. Currently setup will just start replicating from the current active set of tablets, but this leads to some issues as we wouldn't poll from any parent tablets that were split during the bootstrap process - leading to missing data + stuck metadata (as we won't clean up the parent streams from cdc_state). We either need to reconstruct the list of original tablets, or store that somewhere during the bootstrap call

@hulien22 hulien22 added area/docdb YugabyteDB core features xCluster Label for xCluster related issues/improvements status/awaiting-triage Issue awaiting triage labels Jul 6, 2022
@hulien22 hulien22 self-assigned this Jul 6, 2022
@yugabyte-ci yugabyte-ci added kind/bug This issue is a bug priority/medium Medium priority issue labels Jul 6, 2022
@yugabyte-ci yugabyte-ci removed the status/awaiting-triage Issue awaiting triage label Jul 12, 2022
@yugabyte-ci yugabyte-ci added kind/enhancement This is an enhancement of an existing feature and removed kind/bug This issue is a bug labels Jul 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/docdb YugabyteDB core features kind/enhancement This is an enhancement of an existing feature priority/medium Medium priority issue xCluster Label for xCluster related issues/improvements
Projects
None yet
Development

No branches or pull requests

2 participants