Support spot instances [2]

[deliahu]

Tasks

• Expose the relevant spot instance configuration options in eks.yaml and prompt in CLI
• Fetch max spot instance price
• Autogenerate instance types similar to the target instance type
• Suspend inter availability zone rebalancing: aws autoscaling suspend-processes --auto-scaling-group-name <asg-name> --scaling-processes AZRebalance
• Inspect spot instance interrupt frequency

Resources

• eksctl docs
• blog 1: EKS GPU Cluster from Zero to Hero
• blog 2: The definitive guide to running EC2 Spot Instances as Kubernetes worker nodes
• GitHub CA thread
• AWS blog
• AWS CloudFormation docs, EC2 docs
• Stack Overflow

Motivation

Supporting spot instances (by default?) would make it cheaper to run APIs on Cortex