Skip to content

Make standalone compactors config top-level#6471

Merged
nadav-govari merged 3 commits into
nadav/merge-feature-split-mergesfrom
nadav/move-configs
May 31, 2026
Merged

Make standalone compactors config top-level#6471
nadav-govari merged 3 commits into
nadav/merge-feature-split-mergesfrom
nadav/move-configs

Conversation

@nadav-govari
Copy link
Copy Markdown
Collaborator

Description

Makes the standalone compactors config node-level, which makes more sense than in the indexing configs, since its used by three different services: janitor, indexer, compactor.

How was this PR tested?

Unit tests and fixed other tests.

@nadav-govari nadav-govari requested a review from a team as a code owner May 28, 2026 14:58
/// Standalone compactors means that indexer nodes don't run merges.
/// This flag affects the behavior of the compactor service, the indexer service,
/// and the janitor service (the planner lives there). If this flag is enabled and the
/// compactor service is enabled on this node, it'll error. The janitor and indexer will
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The janitor and indexer will?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think im just removing this comment. No need to put whole documentation inline.

}

#[tokio::test]
async fn test_indexer_implicitly_runs_compactor() {
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is that test being removed?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Originally, we were going to force standalone compactors to be false (meaning indexers still had to do merges). To still get merges, we were going to have indexer nodes run both the indexer and compactor service. We decided since then to not go that route, and indexers should no longer implicitly run the compactor service as a result.

@nadav-govari nadav-govari merged commit a5b1b01 into nadav/merge-feature-split-merges May 31, 2026
5 checks passed
@nadav-govari nadav-govari deleted the nadav/move-configs branch May 31, 2026 20:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants