Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replicate aliases from leader to follower #41396

Closed
3 tasks done
jasontedor opened this issue Apr 20, 2019 · 2 comments
Closed
3 tasks done

Replicate aliases from leader to follower #41396

jasontedor opened this issue Apr 20, 2019 · 2 comments
Assignees
Labels
:Distributed/CCR Issues around the Cross Cluster State Replication features >enhancement Meta v7.3.0

Comments

@jasontedor
Copy link
Member

jasontedor commented Apr 20, 2019

CCR deliberately does not apply index templates to follower indices. This is to prevent situations where metadata in the index template could conflict with replication. For example, the number of shards between the leader and the follower must be aligned, so that means that we could never apply the number of shards from an index templates. Similarly for mappings and some settings. Consequently, it was a deliberate design decision that we do not apply index templates to follower indices. One downside of this though is that it means that index aliases need to be applied manually, instead of being picked up from index templates as follower indices are created. However, we could replicate index aliases (including updates) to followers from leaders.

Doing this requires three steps:

  • add aliases version to index metadata (so that we can easily track when alias metadata changes) Introduce aliases version #41397
  • use aliases versions to replicate index aliases to the follower from the leader Replicate aliases in cross-cluster replication #41815
  • reject manually adding aliases to followers? this is very likely the right thing to do otherwise we would have to have a way to distinguish user-added aliases from replicated aliases for the purposes of knowing which are safe to remove when they are removed from the leader (or we have to replicate alias actions instead of the result, which brings with it a ton of issues, like needing a sequence ID on alias actions) Do not allow modify aliases on followers #43017
@jasontedor jasontedor added :Distributed/CCR Issues around the Cross Cluster State Replication features 7x labels Apr 20, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed

@jasontedor
Copy link
Member Author

The implementation for this is complete.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed/CCR Issues around the Cross Cluster State Replication features >enhancement Meta v7.3.0
Projects
None yet
Development

No branches or pull requests

3 participants