Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Discusss] Plugins should use system indices instead of dot indices #3942

Open
gbbafna opened this issue Jul 19, 2022 · 1 comment
Open

[Discusss] Plugins should use system indices instead of dot indices #3942

gbbafna opened this issue Jul 19, 2022 · 1 comment
Labels
discuss Issues intended to help drive brainstorming and decision making Plugins

Comments

@gbbafna
Copy link
Collaborator

gbbafna commented Jul 19, 2022

Describe the bug

ES introduced concept to system indices to supercede dot indices in ES version 7 . There are following benefits to use system indices :

  1. Dedicated read and write pool
  2. Prioritized recovery for system indices
  3. Enable automated upgrade of indices .
  4. There are some dot indices that do not necessarily fit the mold of a normal system index; instead they store data that the system produces with the intent that users can also query against this data. This has mingled with system index definition today , which should rather move to hidden index.
  5. Ease of security configuration for system indices.

The dot indices created by user is a warning in 7.x and deprecated in 8.x in favor of system indices.

I think OpenSearch also move to system indices and move away from dot indices to get the benefits of same .

Additional context

  1. System Indices elastic/elasticsearch#50251
  2. Change AD indices to be hidden indices instead of system indices. opendistro-for-elasticsearch/anomaly-detection#394
  3. Making shard copy count a multiple of attribute count #3462
@gbbafna gbbafna added bug Something isn't working untriaged labels Jul 19, 2022
@ryanbogan ryanbogan added discuss Issues intended to help drive brainstorming and decision making Plugins and removed untriaged bug Something isn't working labels Jul 19, 2022
@dblock
Copy link
Member

dblock commented Jul 21, 2022

I think we'd be open to making a similar change in OpenSearch (without looking at any non-APLv2 code).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discuss Issues intended to help drive brainstorming and decision making Plugins
Projects
None yet
Development

No branches or pull requests

3 participants