Dynamic Index Setting to Exclude Index from Snapshots #76899
Labels
:Data Management/ILM+SLM
Index and Snapshot lifecycle management
>enhancement
Team:Data Management
Meta label for data/management team
Feature Request
It would be nice if there was a dynamic index setting that could be set on an index to have it be excluded from all snapshots.
Use Case
I have a cluster which has an SLM policy that snapshots all indices (
*
).I'm currently migrating some data from a different cluster to this one via remote reindex.
This data is a bit old so as soon as the remove reindex is complete it gets put through ILM to be made a searchable snapshot.
Index Life:
remote reindex
force merge
to1
default compression
tobest compression
snapshot
forsearchable snapshot
What I noticed during this process and what I'd like to stop/prevent, is that the SLM policy takes multiple snapshots of the index while on the hot and warm phases. These snapshots often result in some rather large deltas as the data is frequently changing during this time. I'd like to be able to exclude the index from snapshots during this time so that these delta snapshots aren't generated (as they provide no real value).
This setting would be kind of like setting the
refresh_interval
to-1
, but for snapshots, in the sense that it stops a relatively normal cluster action/operation from happening on the specific index.Bonus
I'd be nice if I could just leave this setting active, then once it hits the cold phase with
searchable snapshot
it removes the setting automatically so that it doesn't have to be a manual processThe text was updated successfully, but these errors were encountered: