Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: VStream API to dynamically include/exclude shards without tablets #15917

Open
twthorn opened this issue May 10, 2024 · 0 comments

Comments

@twthorn
Copy link
Contributor

twthorn commented May 10, 2024

Feature Description

Add ability for vstream to support streaming data from a keyspace where some shards have zero tablets. In addition, if a shard then gets new tablets, the vstream should include the shard that now has tablets and can stream binlogs.

Slack thread

Use Case(s)

The use case here is for keyspaces where tablets are not guaranteed in every shard. This happens for some very large keyspaces. See slack thread for more details. Also in the case where a vstream consumer wants to keep up to real-time as much as possible even if some shards don't have tablets available, and wants to dynamically include them as they become available but not block on every shard being healthy.

@twthorn twthorn added Needs Triage This issue needs to be correctly labelled and triaged Type: Feature Request labels May 10, 2024
@twthorn twthorn changed the title Feature Request: Feature Request: VStream API to dynamically include/exclude shards without tablets May 10, 2024
@mattlord mattlord added Component: VReplication and removed Needs Triage This issue needs to be correctly labelled and triaged labels May 13, 2024
@mattlord mattlord added this to Backlog in VReplication via automation May 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Development

No branches or pull requests

2 participants