feat: Add Native Spot Termination Handling

[jonathan-innis]

Fixes #702

Description

• Adds native handling for spot termination by introducing two new controllers to the AWS cloud provider: aws/controllers/nodetemplate and aws/controllers/interruption
• aws/controllers/nodetemplate is responsible for reconciling the desired state of Karpenter AWS infrastructure with the current state
• aws/controllers/nodetemplate is also responsible for cleaning up the infrastructure when all AWSNodeTemplates are removed
• aws/controllers/interruption is responsible for polling the SQS queue and cordoning and draining instances that it receives notifications for from the SQS queue

How was this change tested?

• make test
• FOCUS=Interruption make e2etests

Does this change impact docs?

• Yes, PR includes docs updates
• Yes, issue opened: #
• No

Release Note

Add Native Spot Termination Handling

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[netlify]

✅ Deploy Preview for karpenter-docs-prod canceled.

Name	Link
🔨 Latest commit	563aa44
🔍 Latest deploy log	https://app.netlify.com/sites/karpenter-docs-prod/deploys/636419035eaa910009779713

[jonathan-innis]

🎉

[FernandoMiguel]

now starts the fun bit of me trying to port all these changes to terraform

[FernandoMiguel]

here's the 1st part for IAM policies aws-ia/terraform-aws-eks-blueprints#1145
once 0.19 comes out , I can test the ConfigMap and the renamed SETs

[auyer]

Hi ! Does this PR mean that it is no longer recommended (or necessary) to install the aws/aws-node-termination-handler resource ?

Thanks!

[ellistarn]

Hi ! Does this PR mean that it is no longer recommended (or necessary) to install the aws/aws-node-termination-handler resource ?

Yep. You can continue to use it, if you prefer.

[bnbrijesh]

Is there any new setup for this , I do not see any docs about the new interruption controller, any help if be awesome.

[ellistarn]

https://karpenter.sh/v0.21.1/concepts/deprovisioning/#interruption

[sap147]

are there updated docs on how to implement this? The above link goes to a page not found. Also, what is the minimum supported version of karpenter that this was introduced in?

[thepoppingone]

https://karpenter.sh/v0.30/concepts/deprovisioning/#consolidation
I think its under here

[thepoppingone]

@sap147

https://karpenter.sh/v0.30/concepts/deprovisioning/#consolidation I think its under here