Skip to content

mma: prototype#142138

Closed
sumeerbhola wants to merge 281 commits intocockroachdb:masterfrom
sumeerbhola:mma_rebalance1
Closed

mma: prototype#142138
sumeerbhola wants to merge 281 commits intocockroachdb:masterfrom
sumeerbhola:mma_rebalance1

Conversation

@sumeerbhola
Copy link
Copy Markdown
Collaborator

Informs #103320

Epic: CRDB-25222

Release note: None

@sumeerbhola sumeerbhola requested a review from kvoli February 28, 2025 16:52
@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

Copy link
Copy Markdown
Collaborator Author

@sumeerbhola sumeerbhola left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @kvoli)


a discussion (no related file):
The first commit is from #142002

@kvoli This depends on support in clusterState that will get added by your PR. The code here is tentative with many TODOs, some of which are trivial, some for post-protoyping, and some dependent on clarifying the semantics we want for diversity decrease. I am leaning towards this being the start of the prototyping branch since we are now starting to write non-data-structure code and much more is subject to change on how we do the integration.

Copy link
Copy Markdown
Collaborator Author

@sumeerbhola sumeerbhola left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @kvoli)


a discussion (no related file):

Previously, sumeerbhola wrote…

The first commit is from #142002

@kvoli This depends on support in clusterState that will get added by your PR. The code here is tentative with many TODOs, some of which are trivial, some for post-protoyping, and some dependent on clarifying the semantics we want for diversity decrease. I am leaning towards this being the start of the prototyping branch since we are now starting to write non-data-structure code and much more is subject to change on how we do the integration.

@kvoli added a commit for rebalancing leases. I'll stop here until we can discuss next steps.

Copy link
Copy Markdown
Contributor

@kvoli kvoli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @sumeerbhola)


a discussion (no related file):

Previously, sumeerbhola wrote…

@kvoli added a commit for rebalancing leases. I'll stop here until we can discuss next steps.

Ack, lets discuss on Monday.

@blathers-crl
Copy link
Copy Markdown

blathers-crl Bot commented Mar 4, 2025

It looks like your PR touches production code but doesn't add or edit any test code. Did you consider adding tests to your PR?

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@kvoli
Copy link
Copy Markdown
Contributor

kvoli commented Mar 4, 2025

Rebased to resolve conflicts.

@kvoli kvoli self-requested a review March 4, 2025 01:47
@blathers-crl
Copy link
Copy Markdown

blathers-crl Bot commented Mar 4, 2025

Your pull request contains more than 1000 changes. It is strongly encouraged to split big PRs into smaller chunks.

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@kvoli kvoli changed the title mma: add allocatorState.rebalanceStores to move ranges for rebalancing mma: prototype Mar 4, 2025
@kvoli kvoli force-pushed the mma_rebalance1 branch 2 times, most recently from 732529c to c4c1dcd Compare March 4, 2025 20:07
@kvoli
Copy link
Copy Markdown
Contributor

kvoli commented Mar 4, 2025

Fixed up the last commit to resolve shadowing a var.

Comment thread pkg/kv/kvserver/allocator/mma/allocator_state.go
Comment thread pkg/kv/kvserver/allocator/mma/load.go
Comment thread pkg/kv/kvserver/stores.go Outdated
@kvoli kvoli force-pushed the mma_rebalance1 branch 3 times, most recently from e66d2d5 to ab19680 Compare March 11, 2025 20:39
@wenyihu6 wenyihu6 force-pushed the mma_rebalance1 branch 5 times, most recently from f601840 to f6b1501 Compare April 2, 2025 13:47
@wenyihu6
Copy link
Copy Markdown
Contributor

wenyihu6 commented Apr 2, 2025

Rebased on master to pick up 607b5e5 - more in https://cockroachlabs.slack.com/archives/CJ0H8Q97C/p1743531027447729. (I show up as a co-author for everything as a result, but I didn't contribute anything 😬)

tbg added a commit to tbg/cockroach that referenced this pull request Jul 9, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
tbg added a commit to tbg/cockroach that referenced this pull request Jul 10, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
tbg added a commit to tbg/cockroach that referenced this pull request Jul 11, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
wenyihu6 pushed a commit to wenyihu6/cockroach that referenced this pull request Jul 12, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>

# Conflicts:
#	docs/generated/settings/settings.html
#	pkg/kv/kvserver/asim/asim.go
#	pkg/kv/kvserver/asim/gossip/gossip.go
#	pkg/kv/kvserver/asim/mmaintegration/BUILD.bazel
#	pkg/kv/kvserver/asim/mmaintegration/mma_store_rebalancer.go
#	pkg/kv/kvserver/asim/queue/lease_queue.go
#	pkg/kv/kvserver/asim/queue/replicate_queue.go
#	pkg/kv/kvserver/asim/state/BUILD.bazel
#	pkg/kv/kvserver/asim/state/impl.go
#	pkg/kv/kvserver/asim/state/state.go
#	pkg/kv/kvserver/asim/tests/testdata/non_rand/example_rebalancing.txt
#	pkg/kv/kvserver/lease_queue.go
#	pkg/kv/kvserver/store.go
#	pkg/kv/kvserver/store_gossip.go
#	pkg/kv/kvserver/store_gossip_test.go
#	pkg/kv/kvserver/stores.go
wenyihu6 added a commit to tbg/cockroach that referenced this pull request Jul 13, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
wenyihu6 added a commit to wenyihu6/cockroach that referenced this pull request Jul 15, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
wenyihu6 added a commit to tbg/cockroach that referenced this pull request Jul 15, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
wenyihu6 added a commit to wenyihu6/cockroach that referenced this pull request Jul 17, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
tbg added a commit to tbg/cockroach that referenced this pull request Jul 21, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
tbg added a commit to tbg/cockroach that referenced this pull request Jul 23, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
wenyihu6 added a commit to tbg/cockroach that referenced this pull request Jul 29, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
tbg added a commit to tbg/cockroach that referenced this pull request Jul 30, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
wenyihu6 added a commit to wenyihu6/cockroach that referenced this pull request Jul 31, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
wenyihu6 added a commit to tbg/cockroach that referenced this pull request Jul 31, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
wenyihu6 added a commit to wenyihu6/cockroach that referenced this pull request Aug 3, 2025
With some package name harmonization, etc.

See cockroachdb#142138 for the commit history represented in this commit.

Informs cockroachdb#103320

Epic: CRDB-25222

Release note: None

Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com>
Co-authored-by: wenyihu6 <wenyi@cockroachlabs.com>
Co-authored-by: Austen McClernon <austen@cockroachlabs.com>
@asg0451 asg0451 mentioned this pull request Aug 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants