Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ILM] Precheck for frozen nodes #89678

Open
smnschneider opened this issue Aug 28, 2022 · 1 comment
Open

[ILM] Precheck for frozen nodes #89678

smnschneider opened this issue Aug 28, 2022 · 1 comment
Labels
:Data Management/ILM+SLM Index and Snapshot lifecycle management >enhancement Team:Data Management Meta label for data/management team

Comments

@smnschneider
Copy link

Description

Describe the feature:

Create a precheck/error message if there is any frozen node available when you configure a frozen phase for a ILM policy.

Describe a specific use case for the feature:

When you configure an ILM policy you can configure a frozen phase even if there is no frozen node available. This results into errors, when ILM tries to move the respective index to the frozen phase.

{
  "indices": {
    "test-000003": {
      "index": "test-000003",
      "managed": true,
      "policy": "test-policy",
      "index_creation_date_millis": 1661437711978,
      "time_since_index_creation": "2.6d",
      "lifecycle_date_millis": 1661437712549,
      "age": "2.6d",
      "phase": "frozen",
      "phase_time_millis": 1661438011771,
      "action": "searchable_snapshot",
      "action_time_millis": 1661438011771,
      "step": "wait-for-data-tier",
      "step_time_millis": 1661438025183,
      "repository_name": "found-snapshots",
      "snapshot_name": "2022.08.25-test-000003-zrez-dqtikalzsbisdy8tibdl9q",
      "step_info": {
        "message": "no nodes for tiers [data_frozen] available"
      },
      "phase_execution": {
        "policy": "zrez",
        "phase_definition": {
          "min_age": "5s",
          "actions": {
            "searchable_snapshot": {
              "snapshot_repository": "found-snapshots",
              "force_merge_index": true
            }
          }
        },
        "version": 2,
        "modified_date_in_millis": 1661438011894
      }
    }
  }
}

Steps to reproduce:

PUT /_cluster/settings?flat_settings=true
{
  "transient" : {
    "indices.lifecycle.poll_interval" : "10s"
  }
}

PUT _index_template/test-template
{
  "index_patterns": ["test*"],                 
  "template": {
    "settings": {
      "index.lifecycle.name": "test-policy",      
      "index.lifecycle.rollover_alias": "test"    
    }
  }
}

PUT _ilm/policy/test-policy
{
  "policy": {
    "phases": {
      "hot": {
        "min_age": "0ms",
        "actions": {
          "rollover": {
            "max_primary_shard_size": "50gb",
            "max_age": "30d"
          },
          "set_priority": {
            "priority": 100
          }
        }
      },
      "frozen": {
        "min_age": "5s",
        "actions": {
          "searchable_snapshot": {
            "snapshot_repository": "found-snapshots",
            "force_merge_index": true
          }
        }
      }
    }
  }
}

PUT test-000001
{
  "aliases": {
    "test": {
      "is_write_index": true
    }
  }
}

POST test/_rollover
#Wait 10 seconds
GET test-000001/_ilm/explain
@smnschneider smnschneider added >enhancement needs:triage Requires assignment of a team area label labels Aug 28, 2022
@DJRickyB DJRickyB added :Data Management/ILM+SLM Index and Snapshot lifecycle management and removed needs:triage Requires assignment of a team area label labels Aug 31, 2022
@elasticsearchmachine elasticsearchmachine added the Team:Data Management Meta label for data/management team label Aug 31, 2022
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Data Management/ILM+SLM Index and Snapshot lifecycle management >enhancement Team:Data Management Meta label for data/management team
Projects
None yet
Development

No branches or pull requests

3 participants