Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable scheduled event draining by default #741

Merged
merged 1 commit into from
Dec 8, 2022

Conversation

johngmyers
Copy link
Contributor

Issue #, if available:

N/A

Description of changes:

Changes the default for scheduled event draining to enabled.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@johngmyers johngmyers requested a review from a team as a code owner December 6, 2022 23:52
@snay2
Copy link
Contributor

snay2 commented Dec 7, 2022

We're not inclined to take this change without a compelling reason for why we should change the default for all customers. Can you elaborate on your motivation?

@johngmyers
Copy link
Contributor Author

The motivation is that without the feature being enabled, the application code may not stop gracefully, take longer to recover full availability, or accidentally schedule work to nodes that are terminated due to a scheduled maintenance event.

Users should not have to make extra effort for systems to have reasonable behavior. The reasonable expectation of a user would be for pods on instances scheduled to be terminated for maintenance would be to have those pods be gracefully evicted, not summarily deleted with the instance.

@snay2
Copy link
Contributor

snay2 commented Dec 8, 2022

Thanks, that's a good argument.

In the past, scheduled event draining was not enabled by default because it was a new feature we added after spot ITN draining. But for a new customer installing NTH now, that historical reason for the defaults doesn't matter.

Since scheduled events come directly from EC2 like spot ITNs and do not require any customer configuration and are a definitive signal that the instance will eventually be terminated (unlike, e.g., rebalance recommendations which merely indicate that the instance is at higher risk of termination).

@snay2 snay2 merged commit c3e411b into aws:main Dec 8, 2022
@johngmyers johngmyers deleted the scheduled-default branch December 8, 2022 17:35
@snay2 snay2 added the Pending-Release Pending an NTH or eks-charts release label Dec 8, 2022
@cjerad
Copy link
Contributor

cjerad commented Dec 14, 2022

Included in release v1.18.2

@cjerad cjerad removed the Pending-Release Pending an NTH or eks-charts release label Dec 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants