Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tablet splitting #1004

Closed
mbautin opened this issue Mar 14, 2019 · 0 comments
Closed

Tablet splitting #1004

mbautin opened this issue Mar 14, 2019 · 0 comments
Assignees
Labels
area/docdb YugabyteDB core features kind/new-feature This is a request for a completely new feature priority/medium Medium priority issue roadmap-tracking-issue This issue tracks a major roadmap item, and usually appears in the roadmap list.

Comments

@mbautin
Copy link
Contributor

mbautin commented Mar 14, 2019

Jira Link: DB-735
Enables dynamically re-sharding the data in a cluster. This is accomplished by allowing each shard (called a tablet) in the cluster to split into two or more tablets at runtime, transparent to the end user.

Prerequisites

✅ Design Doc: automatic re-sharding of data with tablet splitting

Phase 1 - Basic functionality

#1458 Splitting DocDB data files
#1459 Support splitting on the nodes (YB-TServers)
#1460 Refresh tablets seamlessly across nodes
#1461 Drive tablet splitting from master
✅ Ability to manually split tablets (hash and range)

Phase 2 - Automatic splitting

#1461 Mechanism to initiate tablet splitting automatically (from YB-Master leader)
✅ Auto-splitting for range-partitioned tables
✅ Auto-splitting for hash-partitioned tables
#1462 Size-based tablet splitting strategy
#6101 Policy on when to stop splitting
#4929 Cleanup parent tablets from disk after split

Phase 3 - Advanced splitting strategies

#5523 #6424 Compaction improvements to limit the disk utilization
⬜️ #1463 Load-based tablet splitting strategy
⬜️ #5854 Handle YCQL/YSQL retries internally so we avoid application errors
⬜️ #5373 Integration with 2DC
⬜️ #6667 Limit the number of outstanding splits from the master

Analytics

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/docdb YugabyteDB core features kind/new-feature This is a request for a completely new feature priority/medium Medium priority issue roadmap-tracking-issue This issue tracks a major roadmap item, and usually appears in the roadmap list.
Projects
None yet
Development

No branches or pull requests

6 participants
@bmatican @mbautin @ttyusupov @rkarthik007 @yugabyte-ci and others