Skip to content

Implement compactor pipeline update logic#6297

Merged
nadav-govari merged 3 commits intonadav/feature-split-mergesfrom
nadav/pr6
Apr 13, 2026
Merged

Implement compactor pipeline update logic#6297
nadav-govari merged 3 commits intonadav/feature-split-mergesfrom
nadav/pr6

Conversation

@nadav-govari
Copy link
Copy Markdown
Collaborator

@nadav-govari nadav-govari commented Apr 13, 2026

Description

Changes the model of execution a little bit.
Theres a full level of abstraction between the CompactionPipeline and the CompactionSupervisor. The supervisor just spawns pipelines and gets status updates. The pipeline manages the handles and reports the status back.

Added the proto for communicating with the planner service. Build the pipeline status updates, propagate them up, and build the proto for a request.

Actual gRPC logic not yet implemented.

How was this PR tested?

Unit tests.

@nadav-govari nadav-govari changed the base branch from main to nadav/pr5 April 13, 2026 17:04
Comment thread quickwit/quickwit-proto/protos/quickwit/compaction.proto Outdated
Comment thread quickwit/quickwit-proto/protos/quickwit/compaction.proto Outdated
Comment thread quickwit/quickwit-proto/protos/quickwit/compaction.proto Outdated
Comment thread quickwit/quickwit-proto/protos/quickwit/compaction.proto
Comment thread quickwit/quickwit-compaction/src/compactor_supervisor.rs
Base automatically changed from nadav/pr5 to nadav/feature-split-merges April 13, 2026 17:44
@nadav-govari nadav-govari changed the title Nadav/pr6 Implement compactor pipeline update logic Apr 13, 2026
@nadav-govari nadav-govari merged commit f35053e into nadav/feature-split-merges Apr 13, 2026
3 of 4 checks passed
@nadav-govari nadav-govari deleted the nadav/pr6 branch April 13, 2026 18:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant