Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Resiliency] Enable guard rails by default #10063

Open
gbbafna opened this issue Sep 15, 2023 · 1 comment
Open

[Resiliency] Enable guard rails by default #10063

gbbafna opened this issue Sep 15, 2023 · 1 comment

Comments

@gbbafna
Copy link
Collaborator

gbbafna commented Sep 15, 2023

Describe the bug

We have added three systems to protect the cluster from browning it out .

  1. Shard Indexing Backpressure -
  2. Search Backpressure - [RFC] Backpressure in Search Path #1329
  3. Cluster Manager Throttling - Cluster Manager Task Throttling #479

These are disabled by default. It puts the onus users to enable it. Most of them will be unaware of these and will lead to cluster instability .

Expected behavior

All these features should be enabled by default. We can set the default thresholds on a higher side to make this change safer .

@gbbafna gbbafna added bug Something isn't working untriaged Indexing & Search Cluster Manager and removed bug Something isn't working untriaged labels Sep 15, 2023
@shwetathareja
Copy link
Member

shwetathareja commented Jan 24, 2024

+1 @gbbafna to enable these by default with reasonable thresholds.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: 🆕 New
Development

No branches or pull requests

3 participants