Skip to content

Merge planner part 2: gRPCs#6310

Merged
nadav-govari merged 2 commits intonadav/feature-split-mergesfrom
nadav/pr8
Apr 16, 2026
Merged

Merge planner part 2: gRPCs#6310
nadav-govari merged 2 commits intonadav/feature-split-mergesfrom
nadav/pr8

Conversation

@nadav-govari
Copy link
Copy Markdown
Collaborator

Description

Part 2 of the merge planner changes: serving gRPC requests from workers.

On initialization, wait 2 intervals (10 total seconds) to receive status updates from workers on ongoing merges, to seed the in-progress state.

On receiving a request from a worker, clear successful and failed tasks, and remove the splits from the known pool.
Return as many queued merges as there are available slots. Returning 0 is fine.

The rest of the actual logic for this stuff was implemented in part 1, which contained the planner state.

How was this PR tested?

Unit tests.

Comment thread quickwit/quickwit-proto/protos/quickwit/compaction.proto
Comment thread quickwit/quickwit-proto/protos/quickwit/compaction.proto
Base automatically changed from nadav/pr7 to nadav/feature-split-merges April 16, 2026 18:49
@nadav-govari nadav-govari merged commit 7fcb4ce into nadav/feature-split-merges Apr 16, 2026
4 checks passed
@nadav-govari nadav-govari deleted the nadav/pr8 branch April 16, 2026 18:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant