CascadingReindexingTemplate update to drop support for native engine + nuke ReindexingIOConfigRule#19078
Merged
capistrant merged 2 commits intoapache:masterfrom Mar 5, 2026
Conversation
… cascading reindexing
kfaraz
approved these changes
Mar 5, 2026
Contributor
Author
|
thanks for the review, @kfaraz ! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
CascadingReindexingTemplateusage in autocompaction supervisors was originally going to support bothnativeandmsqengine. However, once we added the ability to use virtual columns to extract json fields forReindexingDeletionRulesbased on nested fields, we created functionality that could only work for MSQ but not native. This fracture could keep growing as functionality is added, and instead of trying to manage it, I think it is best to cut the cord on supporting native for this template and instead push forward with just MSQ support. A lot of the community energy is around driving adoption of MSQ over native engine for compaction so I think this makes sense long term.As a result of this decision, the
ReindexingIOConfigRuleis no longer needed as all it existed for was settingdropExistingto true for native so you could create tombstones.Release note
N/A, but this will change the release not for Druid 37 for the cascading reindexing feature in general.
This PR has: